-- Logs begin at Tue 2022-09-13 09:26:13 UTC, end at Tue 2022-09-13 10:33:11 UTC. -- Sep 13 10:06:55.686121 dv-cinder-854274-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 10:06:55.695518 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 10:06:55 2022] *** Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: nodename: dv-cinder-854274-4-iscsi Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: machine: x86_64 Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: clock source: unix Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: pcre jit disabled Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: detected number of CPU cores: 4 Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: current working directory: / Sep 13 10:06:55.697440 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: detected binary path: /usr/bin/uwsgi-core Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: your processes number limit is 47680 Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: your memory page size is 4096 bytes Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: detected max file descriptor number: 2048 Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: lock engine: pthread robust mutexes Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: thunder lock: enabled Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 10:06:55.698134 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 10:06:55.736661 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: Python main interpreter initialized at 0x55e9a554f9c0 Sep 13 10:06:55.736661 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: python threads support enabled Sep 13 10:06:55.736661 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: your server socket listen backlog is limited to 100 connections Sep 13 10:06:55.736661 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: your mercy for graceful operations on workers is 90 seconds Sep 13 10:06:55.737004 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 10:06:55.737111 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: *** Operational MODE: preforking *** Sep 13 10:06:55.737372 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: *** uWSGI is running in multiple interpreter mode *** Sep 13 10:06:55.737372 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: spawned uWSGI master process (pid: 105984) Sep 13 10:06:55.737561 dv-cinder-854274-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 10:06:55.738343 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: spawned uWSGI worker 1 (pid: 105985, cores: 1) Sep 13 10:06:55.738450 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: spawned uWSGI worker 2 (pid: 105986, cores: 1) Sep 13 10:06:55.740406 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 10:06:56.400155 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 10:06:56.402222 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 10:06:57.484129 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:06:57.484129 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: from cryptography.utils import int_from_bytes Sep 13 10:06:57.484637 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:06:57.484637 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: from cryptography.utils import int_from_bytes Sep 13 10:06:57.485028 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:06:57.485028 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: from cryptography.utils import int_from_bytes Sep 13 10:06:57.485139 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:06:57.485139 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: from cryptography.utils import int_from_bytes Sep 13 10:06:59.963826 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 10:06:59.964487 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 10:06:59.964594 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 10:06:59.964664 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 10:06:59.965004 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 10:06:59.965073 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 10:06:59.965200 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 10:06:59.965429 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 10:06:59.965583 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.965792 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 10:06:59.965910 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.966049 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 10:06:59.966234 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.966436 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.966556 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.966766 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.966887 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967088 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967219 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967432 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967527 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967765 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.967861 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968079 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968186 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968398 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968489 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968714 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.968810 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969041 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-4-iscsi {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969133 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969302 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969396 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969615 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969725 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.969943 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-4-iscsi {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970043 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970259 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970359 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970563 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970646 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970876 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.970970 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.971197 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.971300 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.971512 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.971704 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.971834 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972134 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972241 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972450 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972634 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972752 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.972952 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973146 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973313 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973396 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973557 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973712 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.973896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974034 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974212 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974342 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974530 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974670 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974851 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.974983 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.975173 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.975415 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-4-iscsi {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.975502 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.975733 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.975828 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.976047 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.976202 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-4-iscsi {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.976360 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.976519 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.976774 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.977420 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.977604 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.977706 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.977916 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978048 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978239 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978361 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978563 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978671 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978874 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.978993 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979224 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979332 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979551 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979643 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979870 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.979963 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980192 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980277 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980496 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980589 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980808 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.980901 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981118 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981219 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981438 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981533 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981744 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.981836 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982050 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982135 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982301 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982400 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982614 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982706 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982893 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.982977 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983219 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983363 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983547 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983632 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983821 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.983949 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984074 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984171 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984396 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984490 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984661 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984745 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.984981 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985075 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985304 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985391 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985612 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985705 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.985922 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986012 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986230 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986325 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986538 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986632 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986845 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.986940 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987154 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987283 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987484 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987581 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987797 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.987889 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988120 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988204 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988432 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988526 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988757 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.988847 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989069 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989154 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989392 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989504 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.989787 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990027 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990117 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990337 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990433 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990647 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.990970 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991063 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991312 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991411 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991622 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991712 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.991930 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.992022 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.992239 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.992325 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993089 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993186 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993405 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993526 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993730 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.993821 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994067 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994152 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994369 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994460 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994621 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994704 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.994924 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995018 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995259 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995360 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995584 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995893 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.995979 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996193 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996285 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996498 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996587 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996799 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.996884 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997106 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997192 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997412 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997502 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997719 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.997803 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998026 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998177 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998347 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998634 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998729 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.998935 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999030 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999261 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999359 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999568 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999654 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999872 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:06:59.999958 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000190 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000283 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000595 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000804 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.000899 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001110 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001193 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001416 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001500 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001724 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.001809 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002032 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002115 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002342 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002650 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002736 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.002955 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003046 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003296 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003387 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003606 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003701 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003913 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.003996 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004220 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004311 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004519 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004603 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004828 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.004912 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005136 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005229 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005442 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005525 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005746 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.005831 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006051 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006143 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006356 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006438 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006659 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006744 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.006961 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007053 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007287 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007374 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007593 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007675 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007890 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.007985 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010090 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010196 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010288 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010376 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010464 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010531 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010667 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010756 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010834 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.010910 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.011000 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.011079 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.011156 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.011255 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011344 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:07:00.011424 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011514 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011593 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011669 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011745 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011821 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011909 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.011989 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012066 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012142 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012218 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012294 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012386 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012607 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012693 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.012920 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013006 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013238 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013332 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013558 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013648 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013870 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.013962 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014184 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014271 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014503 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014613 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014822 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.014910 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015141 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015278 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015481 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015567 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015801 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.015885 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016114 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016210 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016431 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016555 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016745 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.016830 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017066 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017154 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017377 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017461 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017705 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.017795 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018019 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018106 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018358 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018442 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018683 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.018764 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019004 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019102 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019343 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019431 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019656 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019743 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.019968 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020062 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020281 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020366 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020592 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020687 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020910 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.020994 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021231 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021318 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021544 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021636 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021864 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.021957 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022175 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022259 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022491 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022656 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022804 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.022889 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023113 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023300 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023452 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023549 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023789 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.023875 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024104 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024190 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024433 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024519 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024751 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.024836 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025065 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025157 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025383 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025470 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025697 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.025799 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026007 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026091 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026319 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026404 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026624 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026713 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.026930 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027015 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027258 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027346 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027569 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027655 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027873 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.027957 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028185 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028272 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028492 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028585 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028805 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.028899 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029131 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029215 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029436 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029526 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029746 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.029846 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030058 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030144 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030368 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030458 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030671 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030768 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.030979 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031063 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031310 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031396 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031617 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031715 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.031927 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032012 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032232 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032319 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032542 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032627 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032855 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.032945 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033159 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033243 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033467 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033554 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033773 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.033897 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034083 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034175 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034398 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034484 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034710 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.034793 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.035306 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.035396 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.035620 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.035707 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.035931 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036018 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036241 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036334 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036556 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036640 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036871 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.036957 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037190 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037283 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037517 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037610 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037822 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.037913 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038146 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038242 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038450 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038543 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038761 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.038846 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.039067 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.039181 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.039925 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040015 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040234 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040318 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040543 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040629 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040845 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.040929 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041151 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041242 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041453 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041539 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041755 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.041845 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042058 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042167 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042364 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042467 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042667 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042753 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.042972 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043101 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043300 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043397 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043605 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043689 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.043909 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044116 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044213 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044300 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044543 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044630 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044854 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.044947 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045191 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045275 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045514 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045606 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045828 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.045922 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046146 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046231 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046457 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046555 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046770 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.046871 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047080 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047192 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047417 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047504 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047734 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.047821 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048045 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048128 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048366 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048461 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048674 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048760 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.048993 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049132 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049302 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049386 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049621 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049707 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.049925 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050058 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050329 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050547 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050691 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050863 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.050994 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051228 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051317 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051553 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051649 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051865 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.051989 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052179 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052346 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052489 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052574 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052799 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.052883 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053107 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053200 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053417 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053500 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053727 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.053818 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054034 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054127 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054351 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054438 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054660 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.054744 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.055035 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.055658 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.055889 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056011 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056208 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056338 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056513 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056652 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056824 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.056974 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057156 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057281 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057491 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057599 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057803 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.057928 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058117 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058263 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058440 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058575 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058752 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.058891 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059062 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059234 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059399 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059538 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059704 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.059851 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060010 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060170 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060322 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060490 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060638 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060784 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.060972 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061102 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061290 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061428 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061561 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061714 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.061850 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062025 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062158 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062332 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062463 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062647 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062781 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.062955 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063085 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063284 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063429 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063592 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063721 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.063905 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064035 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064228 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064373 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064541 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064683 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064863 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.064998 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065183 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065312 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065491 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065631 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065795 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.065929 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066096 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066223 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066400 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066539 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066707 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.066834 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067013 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067342 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067444 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067657 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067743 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.067977 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068062 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068284 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068371 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068595 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068681 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068904 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.068991 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069214 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069308 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069526 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069610 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069837 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.069920 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070145 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070266 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070456 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070549 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070793 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.070880 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071109 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071253 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071449 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071548 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071765 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.071880 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072073 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072167 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072384 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072480 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072695 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.072804 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073004 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073098 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073314 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073408 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073623 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073727 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.073928 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.074211 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.074304 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.074524 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.074620 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.074842 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075097 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075208 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075457 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075544 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075780 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.075938 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076079 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076215 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076437 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076591 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076755 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.076884 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077060 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077266 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077401 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077534 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077667 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077799 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.077932 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078076 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078244 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078377 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078549 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078679 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078854 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.078993 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079189 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079323 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079487 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079624 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079789 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.079918 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080091 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080221 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080397 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080503 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080698 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.080786 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081005 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081095 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081307 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081394 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081610 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081697 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081913 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.081999 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082219 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082318 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082534 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082621 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082835 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.082921 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083145 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083261 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083469 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083556 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083773 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.083859 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084080 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084175 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084385 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084479 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084735 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.084823 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085045 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085145 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085369 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085463 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085675 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.085762 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086000 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086088 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086331 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086423 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086637 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086723 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.086941 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087030 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087276 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087368 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087585 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087669 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087888 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.087976 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088198 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088283 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088507 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088610 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088813 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.088900 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089121 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089205 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089428 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089582 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089721 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.089855 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090029 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090159 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090332 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090441 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090640 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090788 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.090945 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091074 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091271 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091460 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091593 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091725 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091858 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.091989 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092163 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092311 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092471 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092608 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092774 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.092903 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093076 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093205 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093386 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093513 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093688 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093816 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.093990 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094118 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094297 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094444 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094602 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094692 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094904 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.094999 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095238 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095339 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095551 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095644 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095854 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.095940 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096159 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096244 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096469 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096564 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096773 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.096858 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097073 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097164 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097379 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097472 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097686 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097772 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.097991 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098076 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098296 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098389 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098610 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098697 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.098915 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099000 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099239 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099343 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099550 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099635 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099854 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.099938 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100241 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100460 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100589 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100762 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.100847 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101065 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101159 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101367 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101450 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101668 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.101758 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.102520 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.102613 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.102825 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.102919 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103130 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103248 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103461 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103556 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103770 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.103885 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104077 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104184 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104382 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104472 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104730 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.104830 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105037 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105136 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105359 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105445 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105674 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105773 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.105989 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106158 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106307 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106395 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106615 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106701 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.106926 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107021 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107263 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107355 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107571 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107657 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107877 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.107965 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108182 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108269 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108499 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108585 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108808 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.108897 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109116 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109204 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109434 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109527 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109749 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.109845 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110062 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110149 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110366 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110459 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110678 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110784 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.110991 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111086 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111324 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111427 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111638 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111724 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.111947 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112031 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112258 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112353 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112570 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112663 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112881 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.112966 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113191 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113286 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113504 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113592 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113814 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.113960 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114124 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114266 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114432 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114561 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114739 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.114870 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115048 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115195 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115385 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115515 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115689 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.115817 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116000 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116131 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116304 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116609 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116746 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.116911 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.117039 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.117216 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.117343 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118070 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118177 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118390 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118487 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118784 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.118872 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119098 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119227 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119440 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119535 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119752 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.119840 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120066 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120162 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120372 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120459 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120706 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.120791 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121011 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121120 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121319 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121407 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121698 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.121783 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122006 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122102 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122311 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122407 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122624 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122712 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.122932 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123020 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123259 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123364 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123574 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123660 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.123884 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124045 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124177 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124309 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124484 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124615 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124792 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.124926 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125120 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125219 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125520 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125758 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.125845 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126177 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126265 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126491 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126585 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126797 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.126890 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127120 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127234 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127472 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127569 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127799 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.127896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128108 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128195 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128512 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.128841 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129065 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129159 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129381 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129466 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129694 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.129794 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130008 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130101 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130317 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130404 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130634 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130728 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.130955 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131057 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131282 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131372 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131607 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131705 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.131930 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132018 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132245 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132331 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132569 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132657 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.132940 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133025 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133290 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133378 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133604 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133692 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.133913 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134000 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134226 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134322 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134532 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134621 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134837 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.134929 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135152 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135278 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135480 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135566 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135786 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.135883 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136097 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136195 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136404 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136488 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136706 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.136791 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137011 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137107 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137316 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137400 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137622 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137708 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.137927 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138021 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138328 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138546 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138630 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138869 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.138956 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139182 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139268 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139515 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139599 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139826 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.139922 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140131 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140216 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140435 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140518 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.140829 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141046 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141143 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141350 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141438 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141654 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141742 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.141998 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142110 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142302 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142401 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142619 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142711 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.142947 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143032 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143298 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143405 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143611 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143704 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.143929 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144015 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144249 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144353 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144571 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144655 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144875 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.144968 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145180 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145280 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145491 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145578 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.145882 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146100 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146187 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146403 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146488 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146707 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.146792 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147009 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147095 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147334 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147421 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147637 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147733 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.147939 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148028 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148242 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148328 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148547 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148633 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148883 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.148970 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149188 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149282 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149493 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149589 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149798 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.149885 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150101 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150195 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150406 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150501 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150709 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.150803 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.151058 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.151209 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.151473 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.151675 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.151855 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.152082 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.152292 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.152486 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.152632 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.152749 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.153570 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.153728 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.153901 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154051 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154214 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154378 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154538 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154698 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.154865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155010 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155207 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155355 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155532 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155852 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.155995 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.156173 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.156496 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.156588 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.156817 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.156903 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157140 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157333 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157456 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157666 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157772 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.157983 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158083 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158300 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158394 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158616 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.158935 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.159029 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.159275 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.159363 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.159593 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.159681 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160169 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160270 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160480 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160567 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160795 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.160880 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161128 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161252 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161452 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161538 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161772 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.161867 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162090 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162179 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162407 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162501 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162724 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.162821 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163042 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163134 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163389 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163478 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163707 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.163806 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.164027 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.164115 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.164870 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.164968 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165179 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165302 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165495 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165581 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165813 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.165908 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166129 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166215 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166442 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166527 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166755 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.166850 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167068 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167154 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167408 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167495 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167722 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.167808 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168040 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168129 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168356 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168442 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168674 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168772 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.168992 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169079 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169314 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169399 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169627 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169833 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.169946 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.170150 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.170266 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.170487 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.170789 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.170888 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171107 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171224 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171462 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171563 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171780 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.171869 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172107 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172192 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172415 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172499 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172742 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.172875 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173038 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173125 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173347 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173431 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173652 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173747 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.173963 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174047 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174277 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174365 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174583 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174670 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.174906 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175027 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175238 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175340 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175549 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175771 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.175859 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.176120 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.176214 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.176439 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.176694 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.176780 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177047 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177141 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177367 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177463 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177685 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.177771 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178012 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178106 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178321 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178420 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178628 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178715 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.178948 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179042 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179283 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179371 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179592 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179679 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.179901 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.180006 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.180773 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.180861 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181083 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181178 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181389 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181525 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181702 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.181789 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182006 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182099 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182313 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182398 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182628 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182716 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.182936 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183030 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183262 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183365 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183580 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183667 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183888 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.183972 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184196 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184290 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184501 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184585 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184809 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.184894 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185118 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185214 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185423 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185557 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185729 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.185814 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186034 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186128 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186343 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186429 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186656 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186742 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.186964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187059 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187305 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187394 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187631 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187716 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.187941 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188036 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188250 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188336 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188570 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188662 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188877 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.188963 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189188 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189281 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189504 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189596 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189818 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.189903 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.190153 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.190251 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.190472 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.190567 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.190788 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.191004 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.191141 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.191369 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.191489 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.191696 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192029 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192117 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192360 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192453 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192673 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192837 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.192973 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193096 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193281 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193375 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193608 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193704 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.193923 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194010 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194233 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194318 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194544 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194630 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194858 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.194952 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.195216 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.195309 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.195504 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196138 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196330 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196420 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196645 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196731 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.196956 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197044 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197270 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197356 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197582 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197682 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197893 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.197979 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198206 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198292 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198516 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198609 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198827 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.198911 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199142 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199247 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199478 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199576 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199799 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.199885 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200117 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200201 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200440 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200528 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200753 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.200839 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201064 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201160 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201377 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201465 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201688 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.201772 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202001 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202096 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202317 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202404 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202631 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202717 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.202937 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.203030 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.203303 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.203623 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.203708 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.203933 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204030 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204261 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204589 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204673 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204904 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.204990 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205226 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205321 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205550 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205643 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205862 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.205946 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206183 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206316 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206497 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206590 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206814 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.206902 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207145 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207281 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207478 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207569 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207813 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.207916 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208120 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208209 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208428 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208543 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208738 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.208836 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209046 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209136 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209365 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209451 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209677 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209774 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.209985 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210081 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210292 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210380 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210604 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210700 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210909 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.210995 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.211771 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.211867 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212095 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212202 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212385 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212479 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212696 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.212782 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213019 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213109 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213311 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213406 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213613 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213698 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.213964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214067 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214227 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214316 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214532 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214616 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214835 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.214923 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215141 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215248 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215480 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215580 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215788 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.215876 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216092 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216178 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216401 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216512 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216704 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.216791 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217117 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217326 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217435 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217659 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217754 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.217971 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218058 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218298 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218400 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218614 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218702 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.218926 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219011 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219274 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219383 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219591 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219679 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219905 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.219990 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220230 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220325 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220542 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220628 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220854 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.220947 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221168 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221264 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221483 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221580 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221796 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.221881 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222110 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222214 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222419 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222514 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222732 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.222828 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223045 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223135 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223522 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223604 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223723 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.223824 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224020 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224123 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224341 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224427 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224656 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224753 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.224977 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225063 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225289 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225372 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225606 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225720 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.225916 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226011 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226230 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226326 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226543 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226636 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.226880 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227047 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227215 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227325 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227534 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227635 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227853 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.227940 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228169 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228254 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228485 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228579 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228807 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.228895 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229119 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229212 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229448 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229535 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229775 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.229863 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230087 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230182 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230418 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230518 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230749 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.230836 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231076 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231191 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231421 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231508 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231737 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.231825 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.232043 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.232132 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.232287 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 10:07:00.232382 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.232689 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.232999 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:07:00.233245 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 10:07:00.387329 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Registered counter for database nova_api Sep 13 10:07:00.389822 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Registered counter for database nova_api Sep 13 10:07:00.406940 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.411517 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.413768 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.417924 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.471349 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.context [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c3ea186-2f17-4a7c-930c-366f78bd7594(cell1) {{(pid=105985) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 10:07:00.475005 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.context [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c3ea186-2f17-4a7c-930c-366f78bd7594(cell1) {{(pid=105986) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 10:07:00.475148 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:07:00.475659 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:07:00.477247 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:07:00.477973 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:07:00.478430 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:07:00.478886 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:07:00.479394 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:07:00.480474 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:07:00.480954 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:07:00.481684 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:07:00.482131 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:07:00.482458 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Registered counter for database nova_cell0 Sep 13 10:07:00.484165 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_concurrency.lockutils [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:07:00.486254 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Registered counter for database nova_cell0 Sep 13 10:07:00.486480 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Registered counter for database nova_cell1 Sep 13 10:07:00.490342 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Registered counter for database nova_cell1 Sep 13 10:07:00.494728 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.497486 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.498812 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.501146 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.501312 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.505876 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.642625 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.645148 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.651185 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO dbcounter [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Registered counter for database nova_cell0 Sep 13 10:07:00.655010 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO dbcounter [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Registered counter for database nova_cell0 Sep 13 10:07:00.660251 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_db.sqlalchemy.engines [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.663751 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:07:00.664924 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writer thread running {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:00.668529 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writer thread running {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:07:01.087438 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:07:01.094664 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:07:01.119755 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:07:01.126984 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:07:01.434632 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:07:01.440615 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: WARNING keystonemiddleware.auth_token [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:07:01.446481 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9a554f9c0 pid: 105985 (default app) Sep 13 10:07:01.448550 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:07:01.449722 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Sep 13 10:07:01.450116 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Tue Sep 13 10:07:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:07:01.464832 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:07:01.470742 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: WARNING keystonemiddleware.auth_token [None req-0b8ad27c-5705-49ac-9e31-86392484d40d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:07:01.476012 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e9a554f9c0 pid: 105986 (default app) Sep 13 10:08:25.362377 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:25.364517 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002661 Sep 13 10:08:25.365069 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:25.382115 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:25.383761 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell0:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:25.384964 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell1:SELECT=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:25.385924 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:26.451707 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-76e213b0-daf6-49cd-809e-80b89b6fb10b admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:26.484884 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-76e213b0-daf6-49cd-809e-80b89b6fb10b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.113263 Sep 13 10:08:26.485714 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Tue Sep 13 10:08:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:29.094702 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:29.095776 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-d2edd950-e2db-4c76-9b64-edffe00bd33c None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 13 10:08:29.096430 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:29.561852 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-c7d22c5a-3d28-419d-a11a-d3d1d02b75f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:29.688509 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-c7d22c5a-3d28-419d-a11a-d3d1d02b75f5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.584180 Sep 13 10:08:29.689004 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:08:29.702627 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:29.703639 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell1:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:29.704358 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=3 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:29.706257 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:29.918021 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-66646aa1-0a5e-4fc1-9695-e01b649cc96f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:30.045472 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-66646aa1-0a5e-4fc1-9695-e01b649cc96f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347838 Sep 13 10:08:30.046065 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Tue Sep 13 10:08:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:32.653121 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-c7d22c5a-3d28-419d-a11a-d3d1d02b75f5 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:32.654144 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-c7d22c5a-3d28-419d-a11a-d3d1d02b75f5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 13 10:08:32.654543 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:33.322254 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-353808e4-6e7f-45d9-a338-dcc41af81ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:33.456631 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-353808e4-6e7f-45d9-a338-dcc41af81ff8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.794652 Sep 13 10:08:33.458052 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:08:33.470612 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bda9ca6d-456a-46d0-af5a-5a42f7c1b67c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:33.562954 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bda9ca6d-456a-46d0-af5a-5a42f7c1b67c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096155 Sep 13 10:08:33.563913 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Tue Sep 13 10:08:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:36.220547 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-353808e4-6e7f-45d9-a338-dcc41af81ff8 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:36.221561 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-353808e4-6e7f-45d9-a338-dcc41af81ff8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 13 10:08:36.221959 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:36.651986 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bbdfffc3-4c70-4bee-9fe3-42664d87ddd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:36.724263 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bbdfffc3-4c70-4bee-9fe3-42664d87ddd6 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495381 Sep 13 10:08:36.724819 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:08:36.738377 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f8d61e8a-baa7-4515-b901-c531107dc5a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:36.837328 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f8d61e8a-baa7-4515-b901-c531107dc5a0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103117 Sep 13 10:08:36.837907 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Tue Sep 13 10:08:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:39.493526 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bbdfffc3-4c70-4bee-9fe3-42664d87ddd6 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:39.494699 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bbdfffc3-4c70-4bee-9fe3-42664d87ddd6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 13 10:08:39.495400 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:39.922924 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-38916f49-5623-41e5-94ba-82d9a05b2aa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "swap": 0, "disk": 10}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:39.976257 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-38916f49-5623-41e5-94ba-82d9a05b2aa5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474453 Sep 13 10:08:39.976906 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:08:39.990203 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-87b813b6-49e4-456b-bdc3-0f6fb0d08e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:40.070830 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-87b813b6-49e4-456b-bdc3-0f6fb0d08e61 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084994 Sep 13 10:08:40.071941 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Tue Sep 13 10:08:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:42.746132 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-38916f49-5623-41e5-94ba-82d9a05b2aa5 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:42.747156 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-38916f49-5623-41e5-94ba-82d9a05b2aa5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 13 10:08:42.747599 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:43.235101 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:43.312574 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558239 Sep 13 10:08:43.313133 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:08:43.325762 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f79ef524-851d-459b-acde-80a1048b6bbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:43.396429 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f79ef524-851d-459b-acde-80a1048b6bbb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074219 Sep 13 10:08:43.404190 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Tue Sep 13 10:08:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:08:46.320636 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:46.321583 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 13 10:08:46.321999 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:46.746321 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-c5c9e75b-a097-4d3e-81c1-d95913774b9a admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:46.771005 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-c5c9e75b-a097-4d3e-81c1-d95913774b9a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442921 Sep 13 10:08:46.771638 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Tue Sep 13 10:08:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:08:49.524664 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:49.525662 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bf94cac2-6e60-4bc4-bb30-07730ad57ccf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 13 10:08:49.526062 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:49.934497 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f21e5a67-c0fe-47af-9303-522d9af280f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:50.050608 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f21e5a67-c0fe-47af-9303-522d9af280f5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.517696 Sep 13 10:08:50.051157 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:08:50.069421 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-b8df19e6-cc52-4950-9e5c-4dc5df024d81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:50.424729 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-b8df19e6-cc52-4950-9e5c-4dc5df024d81 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.365277 Sep 13 10:08:50.425848 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Tue Sep 13 10:08:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:08:53.090248 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f21e5a67-c0fe-47af-9303-522d9af280f5 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:53.092054 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f21e5a67-c0fe-47af-9303-522d9af280f5 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002324 Sep 13 10:08:53.098134 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:53 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:53.565931 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-98093b77-af4c-4e0d-a08f-0def50a90d9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048, "name": "m1.small"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:53.661587 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-98093b77-af4c-4e0d-a08f-0def50a90d9b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.562196 Sep 13 10:08:53.663034 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:08:53.674946 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-e117c3ba-bbb1-4631-b231-264686178ac2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:53.739093 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-e117c3ba-bbb1-4631-b231-264686178ac2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067928 Sep 13 10:08:53.739812 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Tue Sep 13 10:08:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:56.412878 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-98093b77-af4c-4e0d-a08f-0def50a90d9b admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:56.413901 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-98093b77-af4c-4e0d-a08f-0def50a90d9b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 13 10:08:56.414298 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:08:56.874654 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-85fc7e5a-a636-4255-b23f-56d93091cf89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "vcpus": 2, "name": "m1.medium"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:56.952507 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-85fc7e5a-a636-4255-b23f-56d93091cf89 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.532136 Sep 13 10:08:56.953224 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:08:56.965495 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-1f1aaca5-940a-4821-ab75-be04c9143203 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:08:56.970631 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:08:57.082470 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-1f1aaca5-940a-4821-ab75-be04c9143203 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120704 Sep 13 10:08:57.083340 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Tue Sep 13 10:08:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:08:59.692927 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-85fc7e5a-a636-4255-b23f-56d93091cf89 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:08:59.693929 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-85fc7e5a-a636-4255-b23f-56d93091cf89 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 13 10:08:59.694609 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:00.136402 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-de1e8b42-b090-4dbc-9593-7bdc49c2506d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:00.228072 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-de1e8b42-b090-4dbc-9593-7bdc49c2506d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526607 Sep 13 10:09:00.228825 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:08:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:09:00.242594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-e184b05b-40a0-4acd-bfb7-9c193e50e30c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:00.321717 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-e184b05b-40a0-4acd-bfb7-9c193e50e30c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083119 Sep 13 10:09:00.322385 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Tue Sep 13 10:09:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:09:03.102646 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-de1e8b42-b090-4dbc-9593-7bdc49c2506d admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:03.103697 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-de1e8b42-b090-4dbc-9593-7bdc49c2506d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 13 10:09:03.104103 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:03.572114 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "swap": 0, "disk": 160, "ram": 16384}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:03.578746 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:09:03.633082 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.522789 Sep 13 10:09:03.633815 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Tue Sep 13 10:09:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:09:03.647959 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-bbba5567-da20-4181-83c9-29074abcd95e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:03.710563 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-bbba5567-da20-4181-83c9-29074abcd95e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067936 Sep 13 10:09:03.711157 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Tue Sep 13 10:09:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:09:19.781178 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:19.782188 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 13 10:09:19.783097 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:19.794123 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:09:20.172696 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e8bfde0-e775-4da9-92eb-92644f74918a admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:20.190716 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e8bfde0-e775-4da9-92eb-92644f74918a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401103 Sep 13 10:09:20.191284 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Tue Sep 13 10:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:21.502959 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:21.503982 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-7257dd20-1334-4a74-bc88-2a0b2f2df5ec admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 13 10:09:21.504376 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:22.022821 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3c9da736-4f4c-4857-8d4d-5be94438b466 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:22.028089 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-3c9da736-4f4c-4857-8d4d-5be94438b466 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3c9da736-4f4c-4857-8d4d-5be94438b466 admin admin] Request method failure captured: Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept: application/json Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.62 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjIFbR_I-IXdsCizZNw14w9Fyeh5CRQssXH-pn-1l9kc8bV0Eo8453-O4nA23NzczN7BzxUxPbCzX534TZlcW_PKCxoVGLsenMqY-E8rkxGNIxLrgqKHnqoZ9jGTD2ub6ZQ6ToZ16GJ79uKQm5WfzFt9Nl-eshnmb71OIZqoHLQ60SpdU Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Role: reader,member,admin Sep 13 10:09:22.031313 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,member,admin Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User: admin Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: method: > Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: exception: Flavor 42 could not be found. Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '42'} Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:22.033102 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:22.034243 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.035676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3c9da736-4f4c-4857-8d4d-5be94438b466 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:22.036941 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3c9da736-4f4c-4857-8d4d-5be94438b466 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388887 Sep 13 10:09:22.036941 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Sep 13 10:09:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 10:09:22.043417 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-c514fa2c-c917-4112-8ed3-61fbf50de078 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:22.065299 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-c514fa2c-c917-4112-8ed3-61fbf50de078 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026079 Sep 13 10:09:22.065825 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:22.076352 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-a66d9d5f-a667-401e-96c5-ab88afea50ed admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:22.098380 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-a66d9d5f-a667-401e-96c5-ab88afea50ed admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026392 Sep 13 10:09:22.098912 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:22.108395 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-35f38d4c-812f-487c-ba0b-1e4c8027942c admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:22.114352 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-35f38d4c-812f-487c-ba0b-1e4c8027942c admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-35f38d4c-812f-487c-ba0b-1e4c8027942c admin admin] Request method failure captured: Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept: application/json Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.62 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjIFbR_I-IXdsCizZNw14w9Fyeh5CRQssXH-pn-1l9kc8bV0Eo8453-O4nA23NzczN7BzxUxPbCzX534TZlcW_PKCxoVGLsenMqY-E8rkxGNIxLrgqKHnqoZ9jGTD2ub6ZQ6ToZ16GJ79uKQm5WfzFt9Nl-eshnmb71OIZqoHLQ60SpdU Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Role: reader,member,admin Sep 13 10:09:22.117618 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,member,admin Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User: admin Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: method: > Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: exception: Flavor 42 could not be found. Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '42'} Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:22.124944 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:22.125892 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:22.127737 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-35f38d4c-812f-487c-ba0b-1e4c8027942c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:22.128974 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-35f38d4c-812f-487c-ba0b-1e4c8027942c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014410 Sep 13 10:09:22.128974 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Sep 13 10:09:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 10:09:23.334782 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-a66d9d5f-a667-401e-96c5-ab88afea50ed admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:23.335898 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-a66d9d5f-a667-401e-96c5-ab88afea50ed admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 13 10:09:23.336296 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:09:23.856377 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-155d4a6a-b56f-426d-b5c8-9942490cd6a8 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:23.861843 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-155d4a6a-b56f-426d-b5c8-9942490cd6a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-155d4a6a-b56f-426d-b5c8-9942490cd6a8 admin admin] Request method failure captured: Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept: application/json Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.62 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjIFbTdAOgmBOaoqxNjJHKULXO0a_DUjXYavZQzGeYLPPAQrr-TA4hXKgsNX3dOaQCFH3TFHNxrfiTfSx1xmd40-zrnK0KsjAnCGiwV3AQJ4WD4XDTPq63lkHC1NO3AUPzM6n_GQsHKvswLa3f8PKOGavYHR6VocAJ_tw-naMO9DhwavY Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Role: reader,member,admin Sep 13 10:09:23.863433 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,member,admin Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User: admin Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: method: > Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: exception: Flavor 84 could not be found. Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '84'} Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:23.864964 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:23.865896 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.867014 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-155d4a6a-b56f-426d-b5c8-9942490cd6a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:23.868050 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-155d4a6a-b56f-426d-b5c8-9942490cd6a8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391846 Sep 13 10:09:23.868050 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Sep 13 10:09:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 10:09:23.874447 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-ad9e540e-afb6-4971-bd55-f1b7e47e2308 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:23.889720 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-ad9e540e-afb6-4971-bd55-f1b7e47e2308 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018800 Sep 13 10:09:23.890240 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:09:23.899507 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-e6b56817-373e-4cc2-95fa-b9ffdc0a938b admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:23.915068 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-e6b56817-373e-4cc2-95fa-b9ffdc0a938b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019061 Sep 13 10:09:23.915597 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:23.924880 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-6fa9f088-8f4f-415c-a933-474985104f39 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:23.929666 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-6fa9f088-8f4f-415c-a933-474985104f39 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-6fa9f088-8f4f-415c-a933-474985104f39 admin admin] Request method failure captured: Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept: application/json Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.62 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjIFbTdAOgmBOaoqxNjJHKULXO0a_DUjXYavZQzGeYLPPAQrr-TA4hXKgsNX3dOaQCFH3TFHNxrfiTfSx1xmd40-zrnK0KsjAnCGiwV3AQJ4WD4XDTPq63lkHC1NO3AUPzM6n_GQsHKvswLa3f8PKOGavYHR6VocAJ_tw-naMO9DhwavY Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Role: reader,member,admin Sep 13 10:09:23.931155 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,member,admin Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User: admin Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: method: > Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: exception: Flavor 84 could not be found. Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '84'} Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:23.932741 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:23.933586 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:23.934702 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-6fa9f088-8f4f-415c-a933-474985104f39 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:23.935733 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-6fa9f088-8f4f-415c-a933-474985104f39 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011518 Sep 13 10:09:23.935733 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Tue Sep 13 10:09:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 10:09:25.156522 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-e6b56817-373e-4cc2-95fa-b9ffdc0a938b admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:25.157600 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-e6b56817-373e-4cc2-95fa-b9ffdc0a938b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 13 10:09:25.158020 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:25.686908 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-895fd80a-9137-47de-8649-7221362e928e admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:25.692881 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.wsgi [None req-895fd80a-9137-47de-8649-7221362e928e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-895fd80a-9137-47de-8649-7221362e928e admin admin] Request method failure captured: Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept: application/json Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Accept-Encoding: gzip, deflate Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Connection: keep-alive Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Content-Length: 0 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Host: 10.222.0.62 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Openstack-System-Scope: None Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: User-Agent: python-novaclient Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Auth-Token: gAAAAABjIFbVT62Zf7_xxcxIeDc3CP7y_JqWmPQA3n1vyLxjNTXDp8Qfw-xjt2N5bjUmQ-0c488L0X_6wH1CPizcPmxx46p9BHfePjXtTRXPCC_1UDTCWA4FP61GdZT4npVp_8rvr9lvCij-e9mI0b1ld5vJs3dvxgUB2A1t_7--omlqZmwhsV4 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Id: None Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Domain-Name: None Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Identity-Status: Confirmed Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Is-Admin-Project: True Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Id: default Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Domain-Name: Default Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Project-Name: admin Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Role: reader,member,admin Sep 13 10:09:25.694426 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Roles: reader,member,admin Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant: admin Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-Tenant-Name: admin Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User: admin Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Id: default Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Domain-Name: Default Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: X-User-Name: admin Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: method: > Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: exception: Flavor 451 could not be found. Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: action_args: {'id': '451'} Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:25.695797 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:25.699498 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.700965 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-895fd80a-9137-47de-8649-7221362e928e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:25.702233 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-895fd80a-9137-47de-8649-7221362e928e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400326 Sep 13 10:09:25.702233 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:09:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 10:09:25.707652 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-dfbd9d6f-671f-4428-b314-d181b65a8a41 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:25.726373 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-dfbd9d6f-671f-4428-b314-d181b65a8a41 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023740 Sep 13 10:09:25.726994 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:25.738274 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:25.753361 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019244 Sep 13 10:09:25.753899 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Tue Sep 13 10:09:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:09:25.764086 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-43c34f8c-1484-41f2-98c4-ec3ca6df0575 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:25.769374 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.wsgi [None req-43c34f8c-1484-41f2-98c4-ec3ca6df0575 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-43c34f8c-1484-41f2-98c4-ec3ca6df0575 admin admin] Request method failure captured: Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept: application/json Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Accept-Encoding: gzip, deflate Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Connection: keep-alive Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Content-Length: 0 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Host: 10.222.0.62 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-Api-Version: compute 2.92 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Openstack-System-Scope: None Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: User-Agent: python-novaclient Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Auth-Token: gAAAAABjIFbVT62Zf7_xxcxIeDc3CP7y_JqWmPQA3n1vyLxjNTXDp8Qfw-xjt2N5bjUmQ-0c488L0X_6wH1CPizcPmxx46p9BHfePjXtTRXPCC_1UDTCWA4FP61GdZT4npVp_8rvr9lvCij-e9mI0b1ld5vJs3dvxgUB2A1t_7--omlqZmwhsV4 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Id: None Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Domain-Name: None Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Identity-Status: Confirmed Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Is-Admin-Project: True Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Id: default Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Domain-Name: Default Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Project-Name: admin Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Role: reader,member,admin Sep 13 10:09:25.770865 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Roles: reader,member,admin Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/60981a9be15c4b04b78b97afc4285aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant: admin Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Id: 60981a9be15c4b04b78b97afc4285aa0 Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-Tenant-Name: admin Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User: admin Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Id: default Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Domain-Name: Default Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Id: 47dfc0e354ea47fc9cdf40b73108b8fe Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: X-User-Name: admin Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: method: > Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: exception: Flavor 451 could not be found. Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: action_args: {'id': '451'} Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:09:25.772529 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:25.773516 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: ERROR nova.api.openstack.wsgi Sep 13 10:09:25.774594 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-43c34f8c-1484-41f2-98c4-ec3ca6df0575 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:09:25.775712 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-43c34f8c-1484-41f2-98c4-ec3ca6df0575 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012139 Sep 13 10:09:25.775712 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:09:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 10:09:26.990983 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:26.992016 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 13 10:09:26.992413 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:27.525585 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-1e6d1e38-814e-4f90-bbe6-0ff6e0655e6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:27.608686 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-1e6d1e38-814e-4f90-bbe6-0ff6e0655e6b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.476264 Sep 13 10:09:27.609156 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Sep 13 10:09:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:09:28.824504 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:28.825513 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 13 10:09:28.825910 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:29.357195 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-77912fd6-0a11-4d66-9394-d76ca6c38a23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:29.424305 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-77912fd6-0a11-4d66-9394-d76ca6c38a23 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449184 Sep 13 10:09:29.424852 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Sep 13 10:09:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:09:30.641516 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:30.642503 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 13 10:09:30.642889 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:31.164279 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-fa08bf26-1680-4488-afd9-a7cbbdf98f86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:31.226102 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-fa08bf26-1680-4488-afd9-a7cbbdf98f86 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.446244 Sep 13 10:09:31.226664 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Sep 13 10:09:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:09:32.449648 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:32.450674 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 10:09:32.451067 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:32.970528 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-9b9e13dd-bd21-4092-b893-48adba824279 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:09:33.018625 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-9b9e13dd-bd21-4092-b893-48adba824279 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.427905 Sep 13 10:09:33.019179 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Tue Sep 13 10:09:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:09:34.234467 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:34.236134 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Sep 13 10:09:34.236527 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:09:34.762814 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-82ae078b-d458-479c-8c16-54f9204ff27e admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:09:34.786118 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-82ae078b-d458-479c-8c16-54f9204ff27e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.412176 Sep 13 10:09:34.786639 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Tue Sep 13 10:09:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:10:31.488768 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.489774 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-9e88108b-8d41-4a5b-83c0-27761980ab27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 13 10:10:31.490168 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:10:31.501085 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:10:31.880586 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-a5476073-9762-44f1-b15b-d1ea5e19aade admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.904213 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-a5476073-9762-44f1-b15b-d1ea5e19aade admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408033 Sep 13 10:10:31.905271 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:10:31.926924 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=14 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:10:31.930729 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-c6e9d23a-851e-42de-8851-71be61782c90 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.937885 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-c6e9d23a-851e-42de-8851-71be61782c90 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012352 Sep 13 10:10:31.940654 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:10:31.949830 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-53ed5d7d-5825-468d-8125-740456067644 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.957544 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-53ed5d7d-5825-468d-8125-740456067644 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011341 Sep 13 10:10:31.958084 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:10:31.970422 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.977810 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011842 Sep 13 10:10:31.978317 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:10:31.989498 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-a2f1377e-2346-42d7-8a20-babf794f980f admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:10:31.996559 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-a2f1377e-2346-42d7-8a20-babf794f980f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010560 Sep 13 10:10:31.997064 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Tue Sep 13 10:10:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:13:38.076584 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:38.077596 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 13 10:13:38.077987 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:13:38.220328 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=6 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:13:38.388194 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:38.392955 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:38.393428 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:38.393852 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:38.394560 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:38.395002 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:38.395444 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:38.427597 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-8507a0a8-7f9e-4a7a-8023-f52f0522e453 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.208496 Sep 13 10:13:38.428140 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:13:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:13:39.515464 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:39.516474 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 13 10:13:39.516873 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:13:39.712088 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:39.715649 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:39.716144 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:39.716568 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:39.717393 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:39.717835 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:39.718248 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:39.739939 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-5b66a8a6-63a8-4164-aa8a-0544d73b47e4 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.082654 Sep 13 10:13:39.740507 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:13:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:13:51.222100 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:51.223129 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 13 10:13:51.223676 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:13:51.369225 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell0:SELECT=4 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:13:51.369929 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_cell1:SELECT=4 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:13:51.370540 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG dbcounter [-] [105985] Writing DB stats nova_api:SELECT=8 {{(pid=105985) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:13:51.419551 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:51.422939 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:51.423456 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:51.423951 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:51.424695 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:51.425133 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:51.425542 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:51.451682 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-c460644f-c118-4807-9535-9e6ef4ad7dff admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086903 Sep 13 10:13:51.452220 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:13:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:13:52.521403 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG nova.api.openstack.wsgi [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] Calling method '>' {{(pid=105986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:52.522938 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: INFO nova.api.openstack.requestlog [None req-3341b86e-87e9-48b7-b05a-9e6323f3e099 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Sep 13 10:13:52.523372 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: [pid: 105986|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Tue Sep 13 10:13:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:13:52.713967 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG nova.api.openstack.wsgi [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Calling method '>' {{(pid=105985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:13:52.717441 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:52.717912 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:52.718336 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:52.719089 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:13:52.719590 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:13:52.720004 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: DEBUG oslo_concurrency.lockutils [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:13:52.742145 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: INFO nova.api.openstack.requestlog [None req-f3c77c25-ae62-4ddf-b154-2b1b35c98b4b admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079666 Sep 13 10:13:52.742685 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: [pid: 105985|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Tue Sep 13 10:13:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:14:50.239553 dv-cinder-854274-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 10:14:50.240094 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: Tue Sep 13 10:14:50 2022 - graceful shutdown triggered... Sep 13 10:14:50.240521 dv-cinder-854274-4-iscsi devstack@n-api.service[105985]: Gracefully killing worker 1 (pid: 105985)... Sep 13 10:14:50.240875 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: Gracefully killing worker 2 (pid: 105986)... Sep 13 10:14:50.366904 dv-cinder-854274-4-iscsi devstack@n-api.service[105986]: DEBUG dbcounter [-] [105986] Writing DB stats nova_api:SELECT=4 {{(pid=105986) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:14:51.241013 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: worker 1 buried after 1 seconds Sep 13 10:14:51.241738 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: worker 2 buried after 1 seconds Sep 13 10:14:51.241738 dv-cinder-854274-4-iscsi devstack@n-api.service[105984]: goodbye to uWSGI. Sep 13 10:14:51.242654 dv-cinder-854274-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 10:14:51.243232 dv-cinder-854274-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 10:14:51.246130 dv-cinder-854274-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 10:14:51.255825 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 10:14:51.258896 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 10:14:51 2022] *** Sep 13 10:14:51.259039 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 10:14:51.259188 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 10:14:51.259348 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: nodename: dv-cinder-854274-4-iscsi Sep 13 10:14:51.259524 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: machine: x86_64 Sep 13 10:14:51.259674 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: clock source: unix Sep 13 10:14:51.259819 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: pcre jit disabled Sep 13 10:14:51.259957 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: detected number of CPU cores: 4 Sep 13 10:14:51.260107 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: current working directory: / Sep 13 10:14:51.260249 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: detected binary path: /usr/bin/uwsgi-core Sep 13 10:14:51.260398 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: your processes number limit is 47680 Sep 13 10:14:51.260558 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: your memory page size is 4096 bytes Sep 13 10:14:51.260720 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: detected max file descriptor number: 2048 Sep 13 10:14:51.260859 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: lock engine: pthread robust mutexes Sep 13 10:14:51.261165 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: thunder lock: enabled Sep 13 10:14:51.261770 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 10:14:51.262012 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 10:14:51.303498 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: Python main interpreter initialized at 0x556f1a1549c0 Sep 13 10:14:51.303498 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: python threads support enabled Sep 13 10:14:51.303498 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: your server socket listen backlog is limited to 100 connections Sep 13 10:14:51.303498 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: your mercy for graceful operations on workers is 90 seconds Sep 13 10:14:51.303929 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 10:14:51.303929 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: *** Operational MODE: preforking *** Sep 13 10:14:51.304239 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: *** uWSGI is running in multiple interpreter mode *** Sep 13 10:14:51.304239 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: spawned uWSGI master process (pid: 120987) Sep 13 10:14:51.306976 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: spawned uWSGI worker 1 (pid: 121002, cores: 1) Sep 13 10:14:51.306976 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: spawned uWSGI worker 2 (pid: 121003, cores: 1) Sep 13 10:14:51.306976 dv-cinder-854274-4-iscsi devstack@n-api.service[120987]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 10:14:51.304447 dv-cinder-854274-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 10:14:51.964010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 10:14:51.972698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 10:14:53.146295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:14:53.146295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: from cryptography.utils import int_from_bytes Sep 13 10:14:53.147439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:14:53.147439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: from cryptography.utils import int_from_bytes Sep 13 10:14:53.153995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:14:53.153995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: from cryptography.utils import int_from_bytes Sep 13 10:14:53.154448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 10:14:53.154448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: from cryptography.utils import int_from_bytes Sep 13 10:14:55.582113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 10:14:55.583388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 10:14:55.583388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 10:14:55.583388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 10:14:55.583651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 10:14:55.583927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.584318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.584682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.584973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.585313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.585624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.585981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.586310 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.586620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.586891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.587231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.587733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-4-iscsi {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.589798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.590228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.590470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.592701 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.593020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.593346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.593695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.594070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-4-iscsi {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.594391 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.594707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.595023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.595479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.595822 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.596115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.596443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.596771 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.597077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.597407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.597737 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.598060 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.598382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.598735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.599009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.599121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 10:14:55.599744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.599931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 10:14:55.600083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.600267 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 10:14:55.600425 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.600579 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 10:14:55.600729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.600729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.601092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 10:14:55.601250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.601411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.601553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.601694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.601870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602180 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.602918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603096 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603764 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.603918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604226 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604226 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.604987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605130 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854274-4-iscsi {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605795 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.605987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.606976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.607120 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.607382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.607819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.607986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.607986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.608270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.608457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.608605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.608920 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610379 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.610980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.611189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.611355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.611506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.611658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.612772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.612949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613737 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.613737 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854274-4-iscsi {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614592 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.614958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.615141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.615319 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616837 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.616979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617172 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.617954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618105 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618289 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.618892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.619122 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.619934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620081 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.620889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.621994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622215 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622333 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.622959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.623087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.623231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.623350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.623460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.623460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.624524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.624682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.624860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625164 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.625985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626447 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.626783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.627999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.628896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.629045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.629189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.629356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630341 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.630838 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.631812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.631985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.632905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.633247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.633408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.633552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.633694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.633843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.634034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.634034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.634342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.634494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.634638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.634830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.634993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.635137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.635353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.635353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.635635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.635786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.635938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.636123 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.636289 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.636433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.636583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.636725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.636880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.637023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.637165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.637307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.637454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.637607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.637749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.637898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.638075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.638235 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.638378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.638536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.638686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.638905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.639070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.639374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.639528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.640212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.640378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.640523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.640667 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.640815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.640978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.641131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.641274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.641424 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.641575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.641718 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.641870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.642030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.642305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.642477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.642623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.642774 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.642973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.643395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.643560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.643717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.643872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.644036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.644181 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.644323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.644473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.644633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.644785 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.644928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.645070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.645229 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.645384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.645541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.645694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.645845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.645996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.646184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.646341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.646494 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.646644 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.646793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.646937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.647086 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.647324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.647478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.647638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.647791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.647936 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.648086 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.648243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.648443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.648666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.648822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.648973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.649117 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.649259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.649457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.649615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.649777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.650494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.650659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.650659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.650999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.651187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.651352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.651352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.651639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.651783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.651934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.652126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.652282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.652426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.652600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.652756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.652916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.653059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.653243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 10:14:55.653417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.653745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.653912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.654903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.655053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.655227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.655387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.655793 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.655793 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.656085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.656279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.656564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.656867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657766 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.657908 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658215 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658389 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658577 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.658926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.659119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.659288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.659432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.659746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.660000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.660642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.660812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.660981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661132 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661736 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.661886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662171 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662471 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.662983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.663313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.663470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.663651 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.663889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664293 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.664894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.665850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.666861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667232 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.667842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.668872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.669938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.670082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.670247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.670812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.670914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671325 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671875 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.671966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672490 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672679 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672862 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.672945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673653 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673846 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.673954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.674045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.674312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.674410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.674496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675492 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675764 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.675941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676447 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676632 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676724 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.676916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677235 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677332 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.677599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.678783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.681606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.682918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683009 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.683353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.684949 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.685269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.685584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.685869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.685971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.686210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.686527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.686839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.687146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.687295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.687501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.687821 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.688138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.688464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.688561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.688778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.689092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.689789 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.689789 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.690006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.690212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.690328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.690985 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.691323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.691323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.691588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.691726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.691913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.692255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.692357 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.692578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.692913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.693026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.693245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.693570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.694154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.694407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.694694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.694818 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.695020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.695299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.695397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.695661 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.695906 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.696008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.696267 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.696536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.696644 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.696876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.697100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.697203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.697474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.697697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.697798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.698080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.698399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.698932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.699044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.699338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.699460 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.699666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.699980 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.700228 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.700329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.700582 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.701867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.702084 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.702187 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.702533 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.702634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.702845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.703032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.703231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.704464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.704560 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.704645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.704933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.705877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.706028 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.706190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.706503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.706639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.706810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.707120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.707257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.707469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.707770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.707872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.708096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.708371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.708499 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.708696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.708976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.709099 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.709335 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.709627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.709781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.709961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.710251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.710386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.710598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.710904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.711486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.711486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.711670 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.711785 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.711785 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.712094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.712269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.712404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.712726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.712914 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.713018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.713330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.713523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.713638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.713952 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.714198 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.714335 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.714555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.714861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.715144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.715267 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.715517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.715626 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.715823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.716136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.716327 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.716429 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.716739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.716987 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.717082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.717343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.717599 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.717707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.717951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.718202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.718296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.718551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.718796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.719000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.719214 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.719425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.719518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.719798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.720168 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.720297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.720395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.720741 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.720835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.721053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.721711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.721812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.721900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.722084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.722254 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.722904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.723039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.723143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.723143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.730925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732068 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732764 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732915 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.732992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.733962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.734867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.735985 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.736926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737086 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737158 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737442 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737519 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737659 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737818 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.737913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738187 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738825 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.738918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.739709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.740205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.740205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.741622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.741622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.741791 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.742078 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.742438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.742705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.743021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.743358 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.743795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.744207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.744530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.744862 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.745193 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.745526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.745842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.746162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.746478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.746810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.747140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.747488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.747810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.748126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.748457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.748784 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.749104 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.749434 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.749861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.750190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.750508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.750840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.751210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.751321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.751501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.751810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.752127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.752437 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.752644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.752750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.753064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.753387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.753693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.753829 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.754012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.754326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.754635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.754781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.754945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.755295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.755606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.755971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.756151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.756278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.756607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.756701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.756932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.757243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.757572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.757778 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.757875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.758189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.758498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.758805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.759008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.759154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.759484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.759743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.759859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.760134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.760467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.760783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.760958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.761148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.761454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.761798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.761991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.762095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.762405 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.762734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.763992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.764301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.764404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.764606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.764847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.764942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.765208 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.765375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.765513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.765818 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.765912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.766185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.766345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.766446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.766788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.766899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.767130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.767334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.767727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.768136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.768271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.768583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.768678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.768907 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.769061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.769261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.769501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.769606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.769946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.770234 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.770543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.770647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.770867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.772095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.773892 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774238 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774327 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774680 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774862 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.774950 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775156 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775358 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775721 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.775984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.776296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.776655 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.776770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.776895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.777099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.777350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.777553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.777651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.777993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.778089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.778329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.778483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.778658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.778961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.779067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.779344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.779464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.779686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.779903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.780028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.780358 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.780706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.780954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.781091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.781284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.781528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.781669 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.781982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.782087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.782418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.782520 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.782786 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.782879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.783108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.783369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.783466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.783819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.783921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.784145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.784372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.784470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.784774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.784866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.785097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.785274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.785421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.785741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.785845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.786219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.786325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.786670 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.787003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.787097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.787978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.788985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.789088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.789309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.789412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.789669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.789875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790038 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790346 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790450 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.790990 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791102 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.791998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792746 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.792966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793106 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793279 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.793922 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794883 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.794986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.795218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.795334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.795539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.795632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.795852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796074 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.796977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797279 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797631 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.797953 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798155 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.798901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.799288 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.802372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.802566 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.802659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.802756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.802905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.803017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.803646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.803740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.803834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.803928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.804937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805124 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.805945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806567 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.806973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807818 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.807991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808308 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.808937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.809994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.810973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811192 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.811969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.812298 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.812400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.812622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.812747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.812937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.813952 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.814953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.815091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.815453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.818699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.824413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825599 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.825897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826158 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826599 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.826973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827061 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.827927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828192 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828574 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.828940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829118 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.829652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830196 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830286 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.830843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831631 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.831961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832555 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.832927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833797 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.833994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.834906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.835013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.835102 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.837844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838409 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838851 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.838946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839041 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839419 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839773 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.839954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840287 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840674 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.840939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841235 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.841978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.842949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843036 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843430 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.843910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.844004 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.844092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845742 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845907 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.845988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846712 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.846954 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.847049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.847145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.853929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854360 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.854848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855227 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855327 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.855911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856803 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.856884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.857989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.858293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.858679 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.859012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.859357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.859685 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.860009 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.860333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.860654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.860979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.861296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.861620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.861945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.862270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.862843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.863197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.863523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.863849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.864170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.864534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.864863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.865179 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.866114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.866431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.866752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.867091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.867465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.867800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.868143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.868475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.868798 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.869124 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.869448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.869815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.870216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.870489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.870810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.871134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.871482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.872083 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.872301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.872625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.872948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.873266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.873584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.873905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.874225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.874557 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.874898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.875532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.875701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.875881 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.876204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.876780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.877102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.877445 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.877775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.878107 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.878425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.878757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.879090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.882629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.883814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.884154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.884445 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.884763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.885100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.885417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.885735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.886062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.886383 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.886694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.887049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.887403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.887717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.888029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.888349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.888664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.889000 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.889314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.889627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.889942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.890264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.890581 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.890895 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.891230 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.891545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.891865 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.892176 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.892591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.892905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.893270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.893633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.893955 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.894269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.894600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.895085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.895427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.895757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.896076 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.896408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.896756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.897078 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.897435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.897760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.898307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.898709 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.899097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.899400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.899722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.900037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.900349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.900662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.900994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.901313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.901630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.901948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.902265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.902580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.902897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.903234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.903553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.903876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.904191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.904541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.904860 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.905176 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.905745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.906094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.906415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.906744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.907073 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.910401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.911644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.912968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.912968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.913226 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.913427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.913755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.914074 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.914418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.914764 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.915102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.915462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.915715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO dbcounter [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Registered counter for database nova_api Sep 13 10:14:55.915879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.916108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.916421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.916736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.917064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.917381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.917689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.917997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.918312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.918623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.918930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.919272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.919583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.919897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.920237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.920512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.920828 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.921126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.921432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.921741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.922055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.922364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.922675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.923023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.923358 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.923670 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.924010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.924359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.924683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.925112 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.925434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.925763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.926079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.926409 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.926738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.930313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.937783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.939301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.941990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_db.sqlalchemy.engines [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.942271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.943307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.943307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.943307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 10:14:55.943307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 10:14:55.944645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writer thread running {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.000931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.context [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c3ea186-2f17-4a7c-930c-366f78bd7594(cell1) {{(pid=121002) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 10:14:56.004595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO dbcounter [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Registered counter for database nova_api Sep 13 10:14:56.004969 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:14:56.005445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:14:56.007047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:14:56.007824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:14:56.008277 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:14:56.010277 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:14:56.012292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO dbcounter [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Registered counter for database nova_cell0 Sep 13 10:14:56.016397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO dbcounter [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Registered counter for database nova_cell1 Sep 13 10:14:56.023908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_db.sqlalchemy.engines [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.026154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_db.sqlalchemy.engines [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.028000 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.031588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writer thread running {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.034073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writer thread running {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.035131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writer thread running {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.091177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.context [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c3ea186-2f17-4a7c-930c-366f78bd7594(cell1) {{(pid=121003) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 10:14:56.095213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:14:56.095694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:14:56.097258 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:14:56.098005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:14:56.098457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:14:56.101016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:14:56.103007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO dbcounter [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Registered counter for database nova_cell0 Sep 13 10:14:56.107347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO dbcounter [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Registered counter for database nova_cell1 Sep 13 10:14:56.114474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.117233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.122320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writer thread running {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.125013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writer thread running {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.181129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO dbcounter [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Registered counter for database nova_cell0 Sep 13 10:14:56.187948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_db.sqlalchemy.engines [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.192384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writer thread running {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.273444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO dbcounter [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Registered counter for database nova_cell0 Sep 13 10:14:56.280787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_db.sqlalchemy.engines [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 10:14:56.285596 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writer thread running {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 10:14:56.515284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: WARNING keystonemiddleware.auth_token [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:14:56.523408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: WARNING keystonemiddleware.auth_token [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:14:56.608439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: WARNING keystonemiddleware.auth_token [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:14:56.616280 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: WARNING keystonemiddleware.auth_token [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:14:56.869860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: WARNING keystonemiddleware.auth_token [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:14:56.876185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: WARNING keystonemiddleware.auth_token [None req-c5248a2e-dfdb-496e-8fff-b1361df3588a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:14:56.881639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556f1a1549c0 pid: 121002 (default app) Sep 13 10:14:56.959652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: WARNING keystonemiddleware.auth_token [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 10:14:56.964449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: WARNING keystonemiddleware.auth_token [None req-9fe579a1-335b-4470-a3bc-b0093b380262 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 10:14:56.969758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556f1a1549c0 pid: 121003 (default app) Sep 13 10:15:39.315916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:39.317368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:39.318435 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:39.319581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:39.600689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-396d26d0-d53c-43ac-9bb7-49f33e197804 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c200b0d0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:40.311503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-396d26d0-d53c-43ac-9bb7-49f33e197804 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/f0fbfd51-8597-4554-819a-0bc964b4e1f1" status: 200 len: 350 microversion: 2.1 time: 1.004624 Sep 13 10:15:40.312590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 1/1] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:15:39 2022] GET /compute/v2.1/os-volumes/f0fbfd51-8597-4554-819a-0bc964b4e1f1 => generated 350 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:43.056119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:43.060111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:43.062956 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:43.067591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:43.628419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a3d494f3-474c-4e91-b266-efc88930be28 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c200e0d0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:43.650072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1082929044", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "networks": [{"uuid": "6e500297-ade6-4fb0-874a-f549e7fd997d"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:43.878190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] validate_networks() for [('6e500297-ade6-4fb0-874a-f549e7fd997d', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:15:45.123790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a3d494f3-474c-4e91-b266-efc88930be28 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/4f23fcf5-14fd-40d0-8919-0648faa1cf3e" status: 200 len: 351 microversion: 2.1 time: 2.080133 Sep 13 10:15:45.127823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 1/2] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:15:43 2022] GET /compute/v2.1/os-volumes/4f23fcf5-14fd-40d0-8919-0648faa1cf3e => generated 351 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:46.359030 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:15:46.359659 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:15:46.360252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:15:46.361194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:15:46.361194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:15:46.401834 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:46.404281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:46.405872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:46.407989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:46.409031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:46.410937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:46.465240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Getting quotas for project 30beae855402476b9e1e542be6cc7e88. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:15:46.474604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Getting quotas for user ca6855123d0740aba728a2379419cc95 and project 30beae855402476b9e1e542be6cc7e88. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:15:46.486846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:15:46.493299 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:15:46.693559 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9a657683-c97a-45de-8576-30bd1f2b3018 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.449681 Sep 13 10:15:46.707457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1d65e05a-b40c-470b-a281-223c894853a0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:46.714987 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1d65e05a-b40c-470b-a281-223c894853a0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:46.715762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:15:46.906532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1d65e05a-b40c-470b-a281-223c894853a0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:46.939299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1d65e05a-b40c-470b-a281-223c894853a0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1215 microversion: 2.1 time: 0.232505 Sep 13 10:15:46.955328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:46 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:47.094988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-be91b7ec-51e9-4205-9b9e-67f2fcc03981 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1da2f70>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.227435 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-be91b7ec-51e9-4205-9b9e-67f2fcc03981 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb1adcbe-5362-44d6-bd68-3df78fdf2ec1" status: 200 len: 350 microversion: 2.1 time: 0.137458 Sep 13 10:15:47.228402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/os-volumes/fb1adcbe-5362-44d6-bd68-3df78fdf2ec1 => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:47.250070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-04de6afc-24de-4e07-bd6d-e5b908fc5dd0 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1e26820>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.462256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-04de6afc-24de-4e07-bd6d-e5b908fc5dd0 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.216076 Sep 13 10:15:47.463891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1134 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:47.486667 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e8e19735-2599-415e-9cd0-cd24fe5ef8aa tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1539670>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.728598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e8e19735-2599-415e-9cd0-cd24fe5ef8aa tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.245686 Sep 13 10:15:47.729442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1149 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:47.743497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1e2c268c-0d77-4061-bf67-664293a02d17 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c27ed9d0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.935609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1e2c268c-0d77-4061-bf67-664293a02d17 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.195849 Sep 13 10:15:47.936613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1134 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:47.951754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-95aab4de-b5ed-49b1-889d-6225f8579c5b tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1da2ca0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.963294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c65ead63-139a-43c8-b267-0c72bef6c421 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:47.964090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c65ead63-139a-43c8-b267-0c72bef6c421 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:48.161974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-95aab4de-b5ed-49b1-889d-6225f8579c5b tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.214874 Sep 13 10:15:48.171507 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 5/9] 10.222.0.62 () {58 vars in 1167 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:48.176864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0913fc34-a31b-48b1-abd5-9fec629d12c6 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c153e310>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:48.400918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c65ead63-139a-43c8-b267-0c72bef6c421 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:48.410522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c65ead63-139a-43c8-b267-0c72bef6c421 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1215 microversion: 2.1 time: 0.451331 Sep 13 10:15:48.418114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0913fc34-a31b-48b1-abd5-9fec629d12c6 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.245424 Sep 13 10:15:48.418638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 6/10] 10.222.0.62 () {58 vars in 1170 bytes} [Tue Sep 13 10:15:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:48.427550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 5/11] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:47 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1215 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:48.433595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3f8ef4f0-9e70-4527-93b0-479036e4d71d tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c153e940>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:48.756063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3f8ef4f0-9e70-4527-93b0-479036e4d71d tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.326703 Sep 13 10:15:48.757396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1155 bytes} [Tue Sep 13 10:15:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:48.772038 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9519297c-72c3-4b7f-9a91-8d78efa29b22 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1e53430>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:49.085353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9519297c-72c3-4b7f-9a91-8d78efa29b22 tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317769 Sep 13 10:15:49.086967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1188 bytes} [Tue Sep 13 10:15:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:15:49.100302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f6421441-0fb9-420f-a241-ab4b342caeaa tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] Calling method '.version_select at 0x7f46c1539b80>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:49.410945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f6421441-0fb9-420f-a241-ab4b342caeaa tempest-VolumesTestJSON-1949076602 tempest-VolumesTestJSON-1949076602-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.314867 Sep 13 10:15:49.411901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 8/14] 10.222.0.62 () {58 vars in 1155 bytes} [Tue Sep 13 10:15:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:49.437757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-81488031-9f4a-4abd-aa0f-868c2cedb1c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:49.438627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-81488031-9f4a-4abd-aa0f-868c2cedb1c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:49.565482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-81488031-9f4a-4abd-aa0f-868c2cedb1c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:49.575761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-81488031-9f4a-4abd-aa0f-868c2cedb1c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1215 microversion: 2.1 time: 0.141592 Sep 13 10:15:49.588187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:49 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:49.982054 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d42eb08d-f8e6-45f6-bf72-a9a61e773ae2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: .version_select at 0x7f46c15493a0>, body: {"keypair": {"name": "tempest-keypair-1986953892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9LHJXxCuFZoVk376mAjxQ2wgh9wurUXibDx5Dx2ZMcrAl1gxnesLSqUyxf67fn51LSPJ/H9qe6qb+C1jfA6SnnfZWpREF0jonWh9Jqypz4YHlURlschOebxJXliqi+wQ=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:50.035833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-d42eb08d-f8e6-45f6-bf72-a9a61e773ae2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for project b45075d7ec024b3a907d11225942fbee. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:15:50.051001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-d42eb08d-f8e6-45f6-bf72-a9a61e773ae2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for user c069999293a847cdb11650045e22576c and project b45075d7ec024b3a907d11225942fbee. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:15:50.277591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d42eb08d-f8e6-45f6-bf72-a9a61e773ae2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.574497 Sep 13 10:15:50.278223 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 9/16] 10.222.0.62 () {62 vars in 1200 bytes} [Tue Sep 13 10:15:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 576 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 10:15:50.602049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:50.602738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:50.618326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:50.630855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:50.634998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:50.638398 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:50.651275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:50.651801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:50.983334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:51.024145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e947836e-2f05-4279-9874-2c3d9b049195 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1219 microversion: 2.1 time: 0.426846 Sep 13 10:15:51.032397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 8/17] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:50 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1219 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:52.055988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:52.056903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:52.100368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:52.102488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:52.103309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:52.107039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:52.107616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:52.111914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:52.607217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:52.617812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7cef09f1-4ef1-4d06-a9e8-bfa7860f366a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1267 microversion: 2.1 time: 0.567686 Sep 13 10:15:52.619144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 10/18] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:52 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1267 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:15:53.649643 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:53.651006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:53.666133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:53.670673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:53.673091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:53.674093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:53.687734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:53.689873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:53.949885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:53.960365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9174ba21-c3b8-4e0a-af46-80486550b8c3 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1273 microversion: 2.1 time: 0.316525 Sep 13 10:15:53.975255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 9/19] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:53 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:54.053420 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-663961961", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:54.135663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] validate_networks() for [('8ecb5458-53ff-4af9-903b-3aeac85684dc', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:15:56.250316 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a7655bc6-1493-488d-a1ec-c02a5685e54a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: .version_select at 0x7f46c1d95d30>, body: {"keypair": {"name": "tempest-keypair-570581588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgmHTRA2qyOzYhu5qxZBcy8UUVvu06qfQW5ODzXY+RXeRAbmLyFwpTk/7OUDwCL7pOHFYxivUygJTHQwVUse8v7SzxLC5ne44D+IheP40/juVtiiEgmxj0rEgv7R9lBZA=="}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:56.404162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-a7655bc6-1493-488d-a1ec-c02a5685e54a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:15:56.411006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:15:56.412103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:15:56.412750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:15:56.413380 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:15:56.413967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:15:56.421905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-a7655bc6-1493-488d-a1ec-c02a5685e54a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:15:56.449932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:15:56.460980 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:56.461446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:56.461899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:56.462714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:56.467364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:56.470322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:56.541538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:15:56.548325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for user 1cc3e06e1b1440c18c0fb902beeed27d and project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:15:56.580066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:15:56.588486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:15:56.593701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a7655bc6-1493-488d-a1ec-c02a5685e54a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.715720 Sep 13 10:15:56.606414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:15:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:15:56.619051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:56.621938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:56.636470 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:56.638097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:56.639993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:56.649439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:56.649439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:56.649439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:56.843427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8526e61f-1afe-47bd-9222-3bfd4169d044 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.036901 Sep 13 10:15:56.856456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 11/21] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:15:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 3053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:15:56.870428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-716fd7ad-3c23-4f8f-ba80-879205056c49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:56.870428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-716fd7ad-3c23-4f8f-ba80-879205056c49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:57.245632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-716fd7ad-3c23-4f8f-ba80-879205056c49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:57.290044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-716fd7ad-3c23-4f8f-ba80-879205056c49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1221 microversion: 2.1 time: 0.426722 Sep 13 10:15:57.308884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 12/22] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:56 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1221 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:57.706252 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:57.748309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a637e25d-9a20-4041-a47e-c5f05efccb82 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 1.108426 Sep 13 10:15:57.748309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:56 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:57.761874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-437401855", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:57.869841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] validate_networks() for [('8ecb5458-53ff-4af9-903b-3aeac85684dc', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:15:57.955797 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-446943678", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be664f6-b983-4849-835a-b47b5fa17980"}], "security_groups": [{"name": "tempest-securitygroup--1257200561"}], "key_name": "tempest-keypair-1986953892", "user_data": "}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:15:58.329613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] validate_networks() for [('2be664f6-b983-4849-835a-b47b5fa17980', None, None, None, None, None)] {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:15:58.943612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:15:58.944214 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:15:58.944817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:15:58.945227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:15:58.945640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:15:58.967657 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:58.968160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:58.970261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:58.973033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:58.973553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:58.975630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:59.013174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:15:59.020962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for user 1cc3e06e1b1440c18c0fb902beeed27d and project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:15:59.053800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:15:59.056538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:15:59.330779 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d20d0496-272d-40b9-95da-a79ee0abc8c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.557498 Sep 13 10:15:59.333758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 13/24] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:15:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:15:59.346591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:59.351569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:15:59.382457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:59.382457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:59.399356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:59.401331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:15:59.401972 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:15:59.402778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:15:59.814945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:15:59.833053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7352c3cc-4ce7-40ca-a1ae-1a30ed370bc8 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.491213 Sep 13 10:15:59.848839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 14/25] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:59 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:15:59.879016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5a6bc2a4-1e00-4cbd-92a5-effc0e72dec2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:15:59.891740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5a6bc2a4-1e00-4cbd-92a5-effc0e72dec2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:00.039886 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5a6bc2a4-1e00-4cbd-92a5-effc0e72dec2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:00.048416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5a6bc2a4-1e00-4cbd-92a5-effc0e72dec2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1221 microversion: 2.1 time: 0.196837 Sep 13 10:16:00.050685 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 15/26] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:15:59 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:00.874738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:00.875514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:00.901018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:00.903348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:00.906320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:00.907853 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:00.910979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:00.912518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:01.764172 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:01.794824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-10d00370-98d4-4cd7-b5e7-6539db620b9c tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.923771 Sep 13 10:16:01.811603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 16/27] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:00 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:01.813379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:01.815951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:01.859322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:01.863894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:01.867579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:01.869274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:01.871315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:01.874347 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:02.208329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:16:02.208998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:16:02.213130 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:16:02.216763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:16:02.216763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:16:02.259919 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:02.264675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:02.270330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:02.270874 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:02.271863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:02.272476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:02.272994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:02.280876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-aad35f2b-c007-42ed-9d05-4ad39b7e7732 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1225 microversion: 2.1 time: 0.481114 Sep 13 10:16:02.302879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 17/28] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:01 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1225 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:02.331947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for project b45075d7ec024b3a907d11225942fbee. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:16:02.339111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for user c069999293a847cdb11650045e22576c and project b45075d7ec024b3a907d11225942fbee. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:16:02.400012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:16:02.403212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:16:02.635337 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-109616b5-3a2e-4071-ba52-15125ead6362 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.684597 Sep 13 10:16:02.636794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 12/29] 10.222.0.62 () {62 vars in 1188 bytes} [Tue Sep 13 10:15:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 13 10:16:02.652722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:02.653359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:02.821104 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:02.822167 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:02.856844 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:02.868587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:02.884362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:02.884362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:02.884362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:02.884362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:02.894110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:02.908636 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:02.912039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:02.916224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6bc0a1d7-f7a6-4e33-b340-0ef338b3efb3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1281 microversion: 2.20 time: 0.268698 Sep 13 10:16:02.923921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 18/30] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:02 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:03.309656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:03.310280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:03.318434 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:03.318940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:03.319434 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:03.320154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:03.320618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:03.321052 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:03.796614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:03.807820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4515a84b-23ff-415d-86d0-4112e9f27577 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1273 microversion: 2.1 time: 0.501871 Sep 13 10:16:03.829277 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 19/31] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:03 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:04.081476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:04.090934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0efff15b-8211-4d7e-b937-a150d134b4e2 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 1.275871 Sep 13 10:16:04.108815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 13/32] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:02 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:04.119182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:04.131246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:04.469608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:04.486990 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:04.497056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:04.498219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c3766fe6-933f-426d-8d45-011fbbf8ba75 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1281 microversion: 2.20 time: 0.388298 Sep 13 10:16:04.521464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 14/33] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:04 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1281 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:04.556103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1", "tag": "03852249-6bfc-4601-9c18-8131716a0788"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:04.619315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:04.619315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:04.619315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:04.710801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Creating event network-changed:03852249-6bfc-4601-9c18-8131716a0788 for instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 on hv-cinder-85427 Sep 13 10:16:04.711285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 10:16:04.734039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-dd0d599a-c7b2-46b3-afa0-c5e534b91a9c req-61d68612-1ccb-458a-ac46-82e349424dbc service nova] Acquired lock "compute-rpcapi-router" {{(pid=121002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 10:16:04.737009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:04.737885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:04.738881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:04.740087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:04.741728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:04.742985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:04.760718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.compute.rpcapi [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 10:16:04.763895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] Releasing lock "compute-rpcapi-router" {{(pid=121002) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 10:16:04.805629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c3191883-d317-436b-86b8-95d8e743b575 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.976728 Sep 13 10:16:04.807229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 20/34] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:04.840295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:04.841093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:04.853962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:04.856417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:04.857200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:04.859103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:04.859983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:04.862071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:04.862575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1629352768", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a50e7ab-833a-427c-9bea-0d826ae0fb4a"}], "security_groups": [{"name": "tempest-securitygroup--722689396"}], "key_name": "tempest-keypair-570581588", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:05.217000 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:05.247643 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-755802b0-482e-420a-b864-f3359d0c62f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1291 microversion: 2.1 time: 0.408911 Sep 13 10:16:05.250178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 15/35] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:04 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1291 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:05.262446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] validate_networks() for [('3a50e7ab-833a-427c-9bea-0d826ae0fb4a', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:16:05.265466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:05.265466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:05.296440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:05.297277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:05.297763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:05.298538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:05.299099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:05.299612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:05.754982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:05.754982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e3a63361-ceff-48a1-b383-f38f03441c25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.498820 Sep 13 10:16:05.756913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 16/36] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:05 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:05.769904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:05.772927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:05.818847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:05.831660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:05.832183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:05.842789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:05.844731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:05.845807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:06.298505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:06.367281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:06.378639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:06.399526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2af72686-fdc3-484f-9f48-eee134b6ed32 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1285 microversion: 2.20 time: 0.621601 Sep 13 10:16:06.401977 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 17/37] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:05 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1285 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:06.447302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:06.447983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:06.478628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:06.478628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:06.478628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:06.478628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:06.479002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:06.479002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:06.825620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:06.843596 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5f7cdaeb-640b-4700-8adb-fed0eec78715 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1279 microversion: 2.1 time: 0.411102 Sep 13 10:16:06.846842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 18/38] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:06 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1279 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:06.866493 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:06.869777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:06.893302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:06.896115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:06.898192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:06.899447 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:06.902165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:06.902624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.356794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:07.366745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c068d161-f270-402e-bfc2-68416a7f6012 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.517660 Sep 13 10:16:07.369615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:06 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:07.429469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:07.430098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:07.437331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.439333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.439333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.439333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.440076 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.440697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.728056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:07.728056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:07.730021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:07.730021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b74506fa-e22c-4649-a92e-62e8cd68ffdd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1333 microversion: 2.20 time: 0.151699 Sep 13 10:16:07.730021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:07 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:07.868477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:16:07.868477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:16:07.868477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:16:07.868477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:16:07.868477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:16:07.874588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:07.879083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.879606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.880101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:07.880231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.880876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.881372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.882128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.896273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.896803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.908293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.909559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:07.913501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:07.915731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:07.929033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:16:07.958890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:16:07.978503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:16:07.981275 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:16:07.995125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:08.224346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-66abc40c-03b8-44d1-9cb8-945a546675e6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.373265 Sep 13 10:16:08.228856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:16:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:16:08.272441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-385b30d3-fcfd-48fc-800a-41624191da71 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:08.272441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-385b30d3-fcfd-48fc-800a-41624191da71 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:08.695430 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-385b30d3-fcfd-48fc-800a-41624191da71 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:08.711893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-385b30d3-fcfd-48fc-800a-41624191da71 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1241 microversion: 2.1 time: 0.465733 Sep 13 10:16:08.711893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 22/42] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:08 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1241 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:08.743479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:08.744255 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:08.773520 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:08.774569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:08.782903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:08.785633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:08.786127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:08.786574 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:09.162714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.174110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4a635775-0f7a-428c-8058-e8d312353ba6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 1.304980 Sep 13 10:16:09.175372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 21/43] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:07 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:09.203191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:09.204545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:09.214457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:09.215395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:09.216124 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:09.217801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:09.218858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:09.219621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:09.441963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.452631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.454356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.463732 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9655f43c-fc17-4497-8676-b2384e49d9e8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1339 microversion: 2.20 time: 0.261019 Sep 13 10:16:09.464690 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:09 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:09.506050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.522128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4d74273e-c8bf-46b3-9fa0-0eae7c2fc5bd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.792642 Sep 13 10:16:09.522991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 23/45] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:08 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:09.739514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cc32e495-547e-453f-8cb4-b5d6901fdf4d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:09.740381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cc32e495-547e-453f-8cb4-b5d6901fdf4d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:09.851457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-cc32e495-547e-453f-8cb4-b5d6901fdf4d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:09.859922 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cc32e495-547e-453f-8cb4-b5d6901fdf4d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1241 microversion: 2.1 time: 0.125004 Sep 13 10:16:09.875773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 23/46] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:09 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:10.206838 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:10.207771 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:10.216843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.218496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.220827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.223815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.226704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.231304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.494585 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:10.495396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:10.509154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.510323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.510969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.514613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.515255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.515779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.702521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:10.714359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a84e75c7-e2fe-4c7c-80d9-8c53b9e12da5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.512331 Sep 13 10:16:10.715551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 24/47] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:10 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:10.723810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:10.734558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:10.744848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.747009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.747661 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.750712 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:10.751211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:10.751719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:10.787958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:10.812265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:10.814642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:10.816195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-752200ee-3eb1-4137-a8b0-49897b2ae3d2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1339 microversion: 2.20 time: 0.325883 Sep 13 10:16:10.817421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 24/48] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:10 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:11.092434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc04ffd6-17d2-4446-9a30-5bf651dd5a3f", "tag": "268dff1c-90e0-4ad1-8bc5-f2a35cdb4678"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:11.130114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.131272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.132533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.191435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Creating event network-changed:268dff1c-90e0-4ad1-8bc5-f2a35cdb4678 for instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f on hv-cinder-85427 Sep 13 10:16:11.192231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 10:16:11.192856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-02d143df-7c29-4010-8bed-395d3e90c8c6 req-5d2b6c4a-e3af-4d72-8a45-6a433ff50d8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 10:16:11.194225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.195092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.195796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.197138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.197969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.219728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.248513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.compute.rpcapi [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 10:16:11.249765 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b229485-07ab-4767-a818-069643ed7791 None None] Releasing lock "compute-rpcapi-router" {{(pid=121003) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 10:16:11.270889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3b229485-07ab-4767-a818-069643ed7791 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451871 Sep 13 10:16:11.275244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 25/49] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:11.277348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:11.278158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:11.294714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.295598 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.296087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.296916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.297437 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.297970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.495642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:11.499063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-710b0d3f-484d-495c-b5c4-5309ef5582be tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1237 microversion: 2.1 time: 0.226251 Sep 13 10:16:11.500095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 26/50] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:11 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:11.610663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:11.624456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3cad0712-e83a-4122-a729-81ac9522495e tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.907520 Sep 13 10:16:11.628232 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 25/51] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:10 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:11.748909 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:11.749620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:11.772913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.787340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.787340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.787340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.787340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.791724 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.856348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:11.856348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:11.856348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.856348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.857241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:11.857241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:11.857241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:11.857241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:12.313681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.344684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.347487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.353962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.356250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5e3c6caf-67d7-4423-af98-b8eb83ed95dc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.513630 Sep 13 10:16:12.358714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-70a28813-273d-4cb0-bf26-50afd0b4126b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.623952 Sep 13 10:16:12.359583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 27/52] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:11 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:12.369204 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 26/53] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:11 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:12.532683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:12.533319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:12.550950 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:12.551532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:12.575468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:12.575468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:12.575468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:12.575468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:12.593136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:12.653042 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:12.656439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:12.668658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.679270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1494cb65-a1f4-40de-9c88-bc74fd911676 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1293 microversion: 2.1 time: 0.156495 Sep 13 10:16:12.681042 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:12.682709 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 28/54] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:12 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:12.682882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:12.683632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:12.684498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:12.685115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:12.685727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:12.931100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:12.945988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-feab93ee-d7ec-4a17-81c5-0913d597cc3f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.291273 Sep 13 10:16:12.946805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 27/55] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:12 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:13.331565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6baaa6-306e-4c41-b7db-86c38c8b9859", "tag": "9875d9fa-823a-4fd4-a5d8-98b0277f8a95"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:13.344072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.344634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.345079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.357664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] Creating event network-changed:9875d9fa-823a-4fd4-a5d8-98b0277f8a95 for instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 on hv-cinder-85427 Sep 13 10:16:13.363788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-5cfc02c4-6fb2-4020-a68f-ed1b3a7ced41 req-af28caeb-5171-414c-baf8-4549f5295835 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035760 Sep 13 10:16:13.366449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:13.396547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:13.397369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:13.405263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:13.407329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:13.413052 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.413765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.415487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.415724 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.416680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.416903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.417529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.418126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.418584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.419234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.419742 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.420066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.426338 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=73 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:13.840347 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:13.849615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-553f4070-244b-4412-91f6-1ecd9c3c43da tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.458912 Sep 13 10:16:13.850505 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 28/57] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:13 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:13.855595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:13.859801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:13.867478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.868135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.868730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.870188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:13.874570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:13.878948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e65dc308-f73f-40dd-9a9d-dec8e49fd434 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.480549 Sep 13 10:16:13.880084 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 30/58] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:13 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:13.884593 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:13.887020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:13.894402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] Creating event network-changed:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:16:13.901718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-27f251f6-ad23-490c-ba29-9401973f4449 req-1d48bb1e-cb54-4717-8e2c-6c827878a007 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049479 Sep 13 10:16:13.902620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 29/59] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:13.905994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.906659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.907184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.907945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.908454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.909241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.974881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:13.975606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:13.983026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.984022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.984604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.985547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:13.986145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:13.986715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:13.991912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:14.003413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8b834efe-a205-4666-a7a3-f419ed4a6ede tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1301 microversion: 2.1 time: 0.118142 Sep 13 10:16:14.016461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 31/60] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:13 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1301 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:14.229773 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:14.243442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ca25413b-613e-4a35-a473-e6e532771104 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.270506 Sep 13 10:16:14.243442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 30/61] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:13 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:14.873752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:14.874338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:14.876527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:14.881336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:14.881829 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:14.882275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:14.882976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:14.883467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:14.883898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:14.906858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:14.907490 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:14.916768 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:14.917452 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:14.917882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:14.918728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:14.919220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:14.919611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:15.082741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.090923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4422319f-90ee-47a9-a89d-b1ff7049f946 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.221086 Sep 13 10:16:15.105048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 32/62] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:14 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:15.112048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:15.112503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.113434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:15.119473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:15.120179 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:15.120728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:15.121514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:15.121974 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:15.122238 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.122816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:15.126552 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.127769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8c545a85-726a-49c4-a8c2-1ceded63d3d8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.226196 Sep 13 10:16:15.128328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 31/63] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:14 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:15.209673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.222779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-028b4f2b-57b0-4f00-9d26-3bbd6517c8aa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1301 microversion: 2.1 time: 0.116839 Sep 13 10:16:15.225875 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 33/64] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:15 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1301 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:15.264736 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:15.265571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:15.272260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:15.272743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:15.273371 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:15.274067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:15.274698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:15.275351 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:15.495153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:15.504240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0b46cfd5-a694-4450-a356-91c1db42a267 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.243233 Sep 13 10:16:15.519105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 32/65] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:15 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:16.117853 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:16.138467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:16.138467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.138467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.138467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.139376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.139376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.139376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.153211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:16.154549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:16.161257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.162082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.162893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.163948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.164632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.165282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.528830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:16.542501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:16.550484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2baa9c66-17e9-4b2d-8653-8779e736a354 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.437336 Sep 13 10:16:16.552220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:16 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:16.552990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:16.554720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:16.556029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-30b341f8-ba03-4d31-a608-50056a76cfbc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.406700 Sep 13 10:16:16.556859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:16 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:16.558266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:16.559156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:16.561312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:16.562045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:16.566343 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.567075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.567763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.568738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.569079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.569575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.569993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.570098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.570757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:16.571240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:16.571626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.571761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:16.864772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:16.872725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ae395f71-e815-4a4e-80cf-0c0db259f183 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1299 microversion: 2.1 time: 0.319473 Sep 13 10:16:16.873295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 35/68] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:16 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:17.003427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:17.010972 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fa6881e8-1386-42ea-a5e8-fa681cc21c69 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.453044 Sep 13 10:16:17.011587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 34/69] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:16 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:17.577838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:17.585942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:17.588092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:17.588570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:17.607098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:17.615813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:17.616361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:17.622962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:17.622962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:17.622962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:17.622962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:17.623306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:17.623306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:17.623306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:17.623306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:17.623585 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:17.911629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=8 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:18.031280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.044288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.047112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.048703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.050151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9e9cbecb-6b84-46ed-aae1-26e12aa7e562 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.469998 Sep 13 10:16:18.050904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 35/70] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:17 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:18.056243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6bdf130f-1702-4fc2-b64c-bb0905c207ef tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.483665 Sep 13 10:16:18.057513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 36/71] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:17 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:18.066879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:18.068514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:18.075720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:18.077325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:18.078572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:18.079431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:18.080072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:18.081483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:18.082126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:18.082694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:18.089410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:18.091479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:18.092050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:18.092751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:18.093218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:18.093643 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:18.368607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.381780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8615bfb2-8dec-4f0c-9636-82c1d2b73e25 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.322405 Sep 13 10:16:18.411270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 37/72] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:18 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:18.493407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:18.512744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bd5bb45b-42c0-4e20-84da-4fba6e5ede70 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.457877 Sep 13 10:16:18.520363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 36/73] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:18 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:18.808937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1", "name": "network-vif-plugged", "status": "completed", "tag": "03852249-6bfc-4601-9c18-8131716a0788"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:18.821936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:18.822767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:18.823381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:18.836131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] Creating event network-vif-plugged:03852249-6bfc-4601-9c18-8131716a0788 for instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 on hv-cinder-85427 Sep 13 10:16:18.841516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-79bafbb4-f408-4ed6-9b7b-0e556ce4aa81 req-c777175e-1ef9-42e8-8d6d-0de11f9cb3be service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308509 Sep 13 10:16:18.842445 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 38/74] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:19.088042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:19.088428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:19.089540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:19.091189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:19.103182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=36 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:19.105191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.107441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.108105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.108548 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.109191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.109778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.110654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.112184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.113141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.113739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.116635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.117935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.827141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:19.836989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:19.844857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:19.847599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:19.849151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ba69cea9-04f1-4067-bc00-3b46223b7103 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.770157 Sep 13 10:16:19.849294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d754199d-2f30-4b35-9f93-2bf9e9347ec4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.771529 Sep 13 10:16:19.849731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 39/75] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:19 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:19.863392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 37/76] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:19 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:19.863779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:19.866147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:19.872345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=20 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:19.878359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:19.879544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:19.881543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.882041 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.884033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.885113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.887520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.889152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.890397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.891228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.892080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:19.893703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:19.894755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:19.895586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:20.437079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:20.446745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-849d34b3-1bfb-4ff5-9a78-7697ae793468 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.595811 Sep 13 10:16:20.463142 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 40/77] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:19 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:20.473219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bddc8a-d8db-4078-83a2-6149b951e279", "tag": "2fbabe17-010d-4901-979a-668fa9e70da2"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:20.489767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:20.489767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:20.489767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:20.497861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] Creating event network-changed:2fbabe17-010d-4901-979a-668fa9e70da2 for instance 35bddc8a-d8db-4078-83a2-6149b951e279 on hv-cinder-85427 Sep 13 10:16:20.503277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-a1c4fd01-33fd-4213-8db2-51a14d9b0b1a req-b8e5b79e-d9ac-4843-9f24-9bb5ee92a431 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038949 Sep 13 10:16:20.503878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 41/78] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:20.506776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:20.514699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-50b3b043-20a6-4224-86f0-c0c4072e4462 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.649305 Sep 13 10:16:20.515305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 38/79] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:19 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:20.876491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:20.877550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:20.881830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:20.883469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:20.897305 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:20.900208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:20.901148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:20.902137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:20.902763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:20.903416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:20.909877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:20.910394 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:20.911341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:20.912069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:20.912526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:20.912956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.246933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=4 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:21.358199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.366746 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.368312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.369432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5f6541bd-514a-4fa8-ad2e-fe0710f700e9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.494037 Sep 13 10:16:21.369979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 39/80] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:20 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:21.376647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6baaa6-306e-4c41-b7db-86c38c8b9859", "name": "network-vif-plugged", "status": "completed", "tag": "9875d9fa-823a-4fd4-a5d8-98b0277f8a95"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:21.387468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.402849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:21.403365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:21.403978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.404246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-203cd310-ce4f-4740-9c7f-152ffd13be4d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.532707 Sep 13 10:16:21.405101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 42/81] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:20 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:21.426435 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] Creating event network-vif-plugged:9875d9fa-823a-4fd4-a5d8-98b0277f8a95 for instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 on hv-cinder-85427 Sep 13 10:16:21.436933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-4f964325-3972-4a04-b566-8ea5120cb0e7 req-59650120-5494-4d91-88dd-1ca9aabd05c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065446 Sep 13 10:16:21.439274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 40/82] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:21.476064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:21.476796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:21.488151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:21.488757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:21.489274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.490076 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:21.490719 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:21.491432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.539309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:21.540748 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:21.551187 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:21.554878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:21.555415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.556144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:21.556657 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:21.557084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:21.741553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.757838 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:21.758268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9407e745-aeaa-4ea3-a175-b093e0c6bb71 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.285131 Sep 13 10:16:21.758268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 43/83] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:21 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:21.761140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-052f9918-361e-4b53-b503-afc5d412d34c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.226218 Sep 13 10:16:21.761815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 41/84] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:21 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:22.400490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:22.401104 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:22.407979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.408673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.409450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.410312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.410919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.411522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.447146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:22.450868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:22.460172 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.460668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.461110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.461822 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.462269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.462866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.805660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:22.815534 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-edbba382-3c8a-4b50-a5cd-1e712e1bd13c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.385082 Sep 13 10:16:22.828706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 42/85] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:22 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:22.828706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:22.828706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:22.835262 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:22.844433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:22.845940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:22.847077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4e2e9aa7-e7b5-4b54-86f3-68d778d40615 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.450716 Sep 13 10:16:22.847681 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 44/86] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:22 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:22.856658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.857115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.857554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.858260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.858717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.859143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.864493 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:22.866044 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:22.883282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.883282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.883282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:22.883282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:22.883699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:22.883699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:23.121618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:23.125089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:23.129249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-17c17f7b-ac95-406e-a8a0-639f2b1b8adc tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1315 microversion: 2.1 time: 0.307179 Sep 13 10:16:23.129818 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 43/87] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:22 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:23.133556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3aec5947-eeab-4555-96a1-d4fe36ec1c4b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.284864 Sep 13 10:16:23.134133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 45/88] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:22 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:23.461513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc04ffd6-17d2-4446-9a30-5bf651dd5a3f", "name": "network-vif-plugged", "status": "completed", "tag": "268dff1c-90e0-4ad1-8bc5-f2a35cdb4678"}, {"server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "name": "network-vif-plugged", "status": "completed", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:23.473007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:23.474176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:23.474663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:23.487956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Creating event network-vif-plugged:268dff1c-90e0-4ad1-8bc5-f2a35cdb4678 for instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f on hv-cinder-85427 Sep 13 10:16:23.488853 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] Creating event network-vif-plugged:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:16:23.496358 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-00f48ec6-58ab-4858-bfe9-99579df27b9c req-811e3ce6-68a8-435d-9fe5-2b577c3cd830 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039202 Sep 13 10:16:23.498174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 44/89] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:23.843464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:23.844214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:23.850766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:23.854371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:23.854371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:23.854371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:23.854371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:23.854737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:23.885041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:23.885843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:23.893190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:23.893937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:23.894857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:23.895877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:23.896624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:23.897240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:24.081229 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.091128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-89da69e1-6106-4cac-9cbe-90e55625e7d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1321 microversion: 2.1 time: 0.251790 Sep 13 10:16:24.093652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 46/90] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:23 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:24.101705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.120138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.121591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.132839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b628e4d5-06a3-4242-95a3-479995335293 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.254239 Sep 13 10:16:24.133431 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 45/91] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:23 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:16:24.164055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:24.164671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:24.169231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:24.169859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:24.181011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:24.181534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:24.181972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:24.185105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:24.185602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:24.188248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:24.188767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:24.189204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:24.190572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:24.191740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:24.192088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:24.197194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:24.203636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:24.502977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.505463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:24.507062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:24.511986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a1c3d1c5-04c7-4fa1-9f12-d5a53d62a32b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.353790 Sep 13 10:16:24.512560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 46/92] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:24 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:24.526324 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e6452c77-d0a8-40bd-999e-3bbefecf5d55 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1503 microversion: 2.1 time: 0.370426 Sep 13 10:16:24.532206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 47/93] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:24 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:25.115488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:25.116062 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:25.122112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.122599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.123227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.123929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.124387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.124806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.160427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:25.161603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:25.167813 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.168492 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.169116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.170575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.171043 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.171503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.341641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:25.350352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8f22d209-6321-48af-bba7-749c3c7b7196 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1515 microversion: 2.1 time: 0.238791 Sep 13 10:16:25.351237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 47/94] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:25 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:25.374384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:25.376829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:25.377983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:25.383944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.384430 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.384851 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.385712 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.386498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.386776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.388083 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:25.390125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:25.391648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5d3fe2b5-9011-4184-bb09-58eeb5093885 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.235753 Sep 13 10:16:25.392220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 48/95] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:25 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:25.449061 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'flavor' on Instance uuid 9d6baaa6-306e-4c41-b7db-86c38c8b9859 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:16:25.535072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:25.535939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:25.541959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.542519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.542959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.543693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.544150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.544579 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.695755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:25.703733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f373e41e-5e8a-4671-a283-157979f83ec5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.172649 Sep 13 10:16:25.704304 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 49/96] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:25 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:25.852513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-96c5052a-5bca-4dc9-a141-97b28a8bc975 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859/action" status: 200 len: 32 microversion: 2.1 time: 0.481947 Sep 13 10:16:25.857545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 48/97] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:16:25 2022] POST /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859/action => generated 32 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 10:16:25.863193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:25.863801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:25.870003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.870483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.870910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:25.871620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:25.872070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:25.872492 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.069660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:26.077732 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a1174d81-78f3-4a60-9756-a3fb46268628 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.218973 Sep 13 10:16:26.078444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 50/98] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:25 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:26.383341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bddc8a-d8db-4078-83a2-6149b951e279", "name": "network-vif-plugged", "status": "completed", "tag": "2fbabe17-010d-4901-979a-668fa9e70da2"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:26.393339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.394297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.394731 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.407639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] Creating event network-vif-plugged:2fbabe17-010d-4901-979a-668fa9e70da2 for instance 35bddc8a-d8db-4078-83a2-6149b951e279 on hv-cinder-85427 Sep 13 10:16:26.414616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-2c842013-53fb-451e-95e0-27934b18814e req-930b33bb-a592-40a5-8a28-280938ff9466 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035179 Sep 13 10:16:26.415250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 49/99] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:26.417365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:26.417967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:26.424693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.425186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.425641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.426693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.427257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.427638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.626561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:26.638468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:26.640243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:26.641386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-00ebc090-3f85-4b17-a386-cfcbaea28c9b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1407 microversion: 2.20 time: 0.228323 Sep 13 10:16:26.641937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 51/100] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:26 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:26.730115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:26.730823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:26.740366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.740863 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.741302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.744649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.745173 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.745617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.794687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b957bc0e-77ec-4898-befa-0263f596dfa3"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:26.795342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:26.804467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.805305 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.806434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.807411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:26.808044 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:26.808659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:26.944285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:26.949703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ea94451c-c4da-49d3-aa47-8ed4e65d657b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.226781 Sep 13 10:16:26.950762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 50/101] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:26 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:27.101990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:27.110065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:27.110065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.110065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.110065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:27.110428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.110529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.110958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:27.400482 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:27.411066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4d711c15-c1d2-415b-822e-20cc1892c853 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.312439 Sep 13 10:16:27.419304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 51/102] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:27 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:27.670968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:27.671695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:27.678334 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.678961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.679493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:27.680266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.680793 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.681220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:27.935945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:27.945963 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:27.948463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:27.950116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-36b0736c-99a4-41b2-8a2b-884df1f88253 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1600 microversion: 2.20 time: 0.285145 Sep 13 10:16:27.964040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 52/103] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:16:27 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1600 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:16:27.982220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:27.983070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:27.990124 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.990713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.991287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:27.992244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:27.993447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:27.993979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:28.133495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:28.141103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-23bcd047-077c-437c-a4ce-a88c03b03d8e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.171823 Sep 13 10:16:28.141674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 53/104] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:27 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:28.162170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:28.162930 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:28.170634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:28.171088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:28.171565 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:28.172649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:28.173576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:28.173576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:28.330538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cd010799-1e91-4e7d-8965-577e0f21da72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.171932 Sep 13 10:16:28.332306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 54/105] 10.222.0.62 () {60 vars in 1316 bytes} [Tue Sep 13 10:16:28 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:16:28.436452 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:28.437113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:28.449123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:28.450070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:28.450843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:28.452134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:28.454169 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:28.454169 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:28.545071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-714b7b0c-e133-44e2-b5fd-88866bc017f0 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "POST /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.756461 Sep 13 10:16:28.549766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 52/106] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:16:26 2022] POST /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1/os-volume_attachments => generated 194 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:29.143714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:29.150034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e2b2422d-2880-4359-bfae-aa7f8927f157 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.718627 Sep 13 10:16:29.150601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 55/107] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:28 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:29.169896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:29.172161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:29.177812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:29.178315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:29.178783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:29.179524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:29.179978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:29.180399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:29.551852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:29.561653 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-91d7beff-44b0-4abf-8f49-54b34a47adf9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1366 microversion: 2.1 time: 0.397100 Sep 13 10:16:29.562491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 53/108] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:29 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:30.174177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:30.175127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:30.184123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.185266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.186843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.189880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.190354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.191043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.518804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:30.554800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1e08be3b-a2f8-47db-af87-e25514efe733 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.374141 Sep 13 10:16:30.554800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 56/109] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:30 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:30.588004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:30.589346 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:30.600216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.600814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.602039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.603098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:30.603492 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.604292 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.604958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.615185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.615870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.624678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.632049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] Creating event network-changed:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:16:30.641564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-a46f9413-ba51-49af-94f2-5dd880c1389a req-12475151-16a7-41e3-b108-4d160222ee4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043127 Sep 13 10:16:30.646481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 57/110] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:30.864223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:30.872613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8e707613-07fa-42c1-80a5-4372d998f8ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1555 microversion: 2.1 time: 0.291061 Sep 13 10:16:30.874399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 54/111] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:30 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:30.899359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:30.901029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:30.906595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.907105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.907542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:30.909288 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:30.909922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:30.910522 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:31.040233 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d9b00506-4a4d-4a80-a8f9-480226718365 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145050 Sep 13 10:16:31.040915 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 58/112] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:16:30 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:31.567578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:31.568249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:31.578489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:31.581991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:31.582717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:31.583665 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:31.584289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:31.587597 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:31.777143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:31.796037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-10f230b7-a6e2-4d93-8a53-f811a18147ee tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.232055 Sep 13 10:16:31.798131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 55/113] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:31 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:32.772226 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bddc8a-d8db-4078-83a2-6149b951e279", "tag": "2fbabe17-010d-4901-979a-668fa9e70da2"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:32.781794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:32.782280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:32.782732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:32.794092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] Creating event network-changed:2fbabe17-010d-4901-979a-668fa9e70da2 for instance 35bddc8a-d8db-4078-83a2-6149b951e279 on hv-cinder-85427 Sep 13 10:16:32.799908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-85ae1858-eeaf-48b2-822e-1db538c5c44a req-310d3ab9-13b5-49e0-89d8-2d05c6df4810 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Sep 13 10:16:32.800517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 59/114] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:32.825307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:32.825978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:32.832848 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:32.833555 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:32.834111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:32.834830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:32.835458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:32.835909 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:33.013201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:33.029524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-accd946a-50be-486c-b469-3649445f882a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.208829 Sep 13 10:16:33.030562 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 56/115] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:32 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:34.054371 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:34.055348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:34.066766 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:34.067569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:34.068194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:34.075116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:34.075830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:34.076376 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:34.238584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:34.246730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ff1f2192-306a-4f08-b774-67ead73761a0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.196992 Sep 13 10:16:34.250126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 60/116] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:34 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:35.270217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:35.270858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:35.277420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:35.277934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:35.278399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:35.279141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:35.279874 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:35.283465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:35.413738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:35.424426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8af25eba-af14-4b87-bba7-113ece2dd2ba tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.155480 Sep 13 10:16:35.424426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 57/117] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:35 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:36.445593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:36.446237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:36.452496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:36.454744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:36.454744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:36.454744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:36.455280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:36.455994 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:36.610325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:36.618622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2a8e2db7-fae3-488c-a551-29853a8e35d9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.177896 Sep 13 10:16:36.619212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 61/118] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:36 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:37.641129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:37.643401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:37.651869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:37.652357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:37.652787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:37.653481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:37.653931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:37.654346 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:37.806905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:37.815489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9bc08b96-989e-49a1-8750-3579ea0f6109 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.178410 Sep 13 10:16:37.817756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 58/119] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:37 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:38.840012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:38.840621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:38.846922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:38.847442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:38.847879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:38.848577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:38.849045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:38.849494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:38.977760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:38.985446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e6bdf09b-7ee5-4996-a865-4b4b2f2577f9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.149429 Sep 13 10:16:38.986008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 62/120] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:38 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:40.007777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:40.008404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:40.014798 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:40.016425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:40.016425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:40.016425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:40.016967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:40.017394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:40.151833 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:40.158806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8f3eb28d-6c17-4885-855d-f7c1169f3680 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.154848 Sep 13 10:16:40.159479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 59/121] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:40 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:41.182217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:41.182831 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:41.184909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=85 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:41.190220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:41.190716 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:41.191148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:41.192055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:41.192678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:41.193108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:41.335192 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:41.342799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-40228f82-ed04-4ae4-9202-30adfa21fb3b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.164495 Sep 13 10:16:41.343402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 63/122] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:41 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:42.054048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-489870013", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "networks": [{"uuid": "b640de2f-1d12-4bb4-bb69-1af7b73e7f86"}]}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:42.109447 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] validate_networks() for [('b640de2f-1d12-4bb4-bb69-1af7b73e7f86', None, None, None, None, None)] {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:16:42.366244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:42.366849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:42.373387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:42.373714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:42.374140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:42.374882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:42.375378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:42.384937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:42.384937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:42.537415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:16:42.537912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:16:42.538458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:16:42.538870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:16:42.539316 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:16:42.549863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:42.550359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:42.551932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:42.551932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:42.552388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:42.552812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:42.558180 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:42.566471 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b9b019a2-d949-4a80-97d1-4da7409948d3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.204865 Sep 13 10:16:42.567039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 64/123] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:42 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:42.570617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Getting quotas for project 723137b6e4764ec6b58b46f84a05a37e. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:16:42.574851 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Getting quotas for user 6c886285823a45a0b921a180d5bf4f1e and project 723137b6e4764ec6b58b46f84a05a37e. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:16:42.591330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:16:42.591330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:16:42.740967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b0eb8c53-ae79-4c08-8193-4688f8b038ce tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690462 Sep 13 10:16:42.748085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 60/124] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:16:42.754745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bd51dc57-cc21-4feb-a2a6-04450724b1e5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:42.755388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bd51dc57-cc21-4feb-a2a6-04450724b1e5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:42.807406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bd51dc57-cc21-4feb-a2a6-04450724b1e5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:42.814434 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bd51dc57-cc21-4feb-a2a6-04450724b1e5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1213 microversion: 2.1 time: 0.063891 Sep 13 10:16:42.815024 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 65/125] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:42 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:43.003485 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:43.003989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:43.010524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.011022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.011480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.012171 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.012627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.013053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.037847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:16:43.198461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:43.395499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e4572c34-5a70-4c6d-9790-b7f4ca90e0af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 204 len: 0 microversion: 2.1 time: 0.396201 Sep 13 10:16:43.396105 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 61/126] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:16:42 2022] DELETE /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:16:43.409216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:43.409833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:43.416939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.417414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.417845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.418524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.418971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.419422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.551189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:43.559612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b242d9c5-dfc9-45f5-9f94-22493711038b tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1555 microversion: 2.1 time: 0.154194 Sep 13 10:16:43.560183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 66/127] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:43 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:43.590541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:43.591392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:43.597443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.597935 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.598388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.599100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:43.599583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:43.600007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:43.730656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:43.738852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7feca27d-d47d-466d-8325-92505174654c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.152646 Sep 13 10:16:43.739873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 62/128] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:43 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:43.843109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-93bdc3fa-f8c5-4ff2-bef2-8ead96389f3f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:43.843751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-93bdc3fa-f8c5-4ff2-bef2-8ead96389f3f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:43.894333 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-93bdc3fa-f8c5-4ff2-bef2-8ead96389f3f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:43.901200 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-93bdc3fa-f8c5-4ff2-bef2-8ead96389f3f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1213 microversion: 2.1 time: 0.062129 Sep 13 10:16:43.901762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 67/129] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:43 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:44.583927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:44.584462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:44.591142 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.591638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.592063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.592804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.593250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.593666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.718880 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:44.727525 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7dfddfd3-fce2-4a14-8482-fc49e87fed09 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1555 microversion: 2.1 time: 0.148445 Sep 13 10:16:44.728162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 63/130] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:44 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:44.762122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:44.762727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:44.769588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.770069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.770497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.771207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.771660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.772082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.908217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:44.915738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-55c697e5-6850-4713-9efb-1df5da454dc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.157896 Sep 13 10:16:44.916293 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 68/131] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:44 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:44.924824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:44.927356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:44.932099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.932584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.933015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.933698 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:44.934149 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:44.934572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:44.994373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:45.002895 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d6374b3b-940f-40f5-b08e-41ff1a0ad21f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1217 microversion: 2.1 time: 0.082304 Sep 13 10:16:45.003489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 64/132] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:44 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:45.750185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:45.750805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:45.757243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:45.757720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:45.758154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:45.758885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:45.759379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:45.759830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:45.886142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:45.895055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3d9316bc-d9fe-4c39-b419-045dd4972575 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1555 microversion: 2.1 time: 0.148828 Sep 13 10:16:45.895645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 69/133] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:45 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:45.937931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:45.938564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:45.945611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:45.946082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:45.946508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:45.947277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:45.947733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:45.948165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:46.026050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:46.026615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:46.032841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:46.041693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:46.041693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:46.041693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:46.041693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:46.042074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:46.091098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:46.099785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-02571cb9-31f1-45a0-a151-9746b28eed76 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.165588 Sep 13 10:16:46.100586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 65/134] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:45 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:46.107530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:46.115502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-41a9653e-73db-46f1-bdb3-4455ae14ded6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1217 microversion: 2.1 time: 0.093591 Sep 13 10:16:46.116053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 70/135] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:46 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:46.917742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:46.918376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:46.924287 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:46.924772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:46.925210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:46.925893 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:46.926364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:46.926791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:47.057607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:47.068988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ce6c879d-5aa3-4d13-8425-84444b7741af tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1555 microversion: 2.1 time: 0.155010 Sep 13 10:16:47.079855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 66/136] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:46 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:47.122833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:47.123466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:47.129299 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:47.129828 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:47.130258 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:47.131071 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:47.131543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:47.131957 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:47.137921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:47.138604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:47.148205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:47.149079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:47.150408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:47.150692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:47.152466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:47.152466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:47.234106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:47.245363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b0e08cdc-c8a4-4683-ac44-8cfe71e9db81 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1217 microversion: 2.1 time: 0.111272 Sep 13 10:16:47.246413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 67/137] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:47 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:47.298447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:47.306158 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cf0ee6bb-c878-48c0-9760-254c49fff9f7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.187278 Sep 13 10:16:47.306721 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 71/138] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:47 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:48.093174 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:48.093719 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:48.096837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:48.101994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.102491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.102980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.103766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.104223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.104664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.269778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:48.270422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:48.276985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.277491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.277909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.279092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.279858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.280287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.399269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:48.412385 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-02f846b8-01c9-4873-8df5-6a3834b152c3 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1265 microversion: 2.1 time: 0.146760 Sep 13 10:16:48.413728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 72/139] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:48 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:48.431698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:48.432591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:48.440462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.441249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.441760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.443416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:48.444051 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:48.446127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:48.485802 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:48.494867 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d0fa7775-6b36-4291-b1d3-4bb10958444a tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1555 microversion: 2.1 time: 0.405573 Sep 13 10:16:48.495459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 68/140] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:48 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1555 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:48.669135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:48.678235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bf68ad08-b10f-461d-9dea-8783641a0ba0 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.263259 Sep 13 10:16:48.678824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 73/141] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:48 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:49.171146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1", "name": "network-vif-deleted", "tag": "03852249-6bfc-4601-9c18-8131716a0788"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:49.203245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.203955 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.204662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.222821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] Creating event network-vif-deleted:03852249-6bfc-4601-9c18-8131716a0788 for instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 on hv-cinder-85427 Sep 13 10:16:49.255551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-5913cbce-3d28-4a56-9bd0-5cf3a3d7a249 req-4c518fe5-d08b-4beb-89ba-f0eead2ad658 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080132 Sep 13 10:16:49.256903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 69/142] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:49.438494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:49.439176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:49.445480 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.446185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.446611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.447352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.448872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.449514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.531711 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:49.533011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:49.543387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.543978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.544540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.545433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.545944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.546458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.561551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:49.570166 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a6325f4a-ba01-4757-8442-dc00f798754f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1283 microversion: 2.1 time: 0.136670 Sep 13 10:16:49.571108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 74/143] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:49 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:49.611012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:49.619262 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2438741e-5ddc-4991-8f19-616c89a3c9c9 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1346 microversion: 2.1 time: 0.100895 Sep 13 10:16:49.619835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 70/144] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:49 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:49.701752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:49.702406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:49.708367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.708836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.709258 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.709940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:49.710388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:49.710796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:49.982595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:50.001542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ae7beb58-9254-4096-8198-b8345e41ad14 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.303501 Sep 13 10:16:50.003246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 75/145] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:49 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:50.593766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:50.596539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:50.601402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:50.601953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:50.602384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:50.603278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:50.603726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:50.604308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:50.642974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:50.643617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:50.652176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:50.652921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:50.653526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:50.654391 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:50.655273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:50.655849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:50.694168 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:50.694667 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:50.695475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:50.696123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lazy-loading 'fault' on Instance uuid f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:16:50.749676 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:50.760094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f954f2f1-97c6-4a22-9b8a-fefce5b80025 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1351 microversion: 2.1 time: 0.121867 Sep 13 10:16:50.760783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 76/146] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:50 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:50.803285 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:50.817768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-73b77c1d-9451-4210-b5c1-bd1570368c24 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.228360 Sep 13 10:16:50.818500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 71/147] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:50 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:51.026678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:51.028131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:51.040271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.042672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.043327 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.045261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.046954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.051259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.200392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:51.210022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-57fd7ee3-eb77-4968-9a99-804d5b742a89 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.188747 Sep 13 10:16:51.210669 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 77/148] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:51 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:51.285218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba3f564-bb85-4a42-a420-3ea3811a814f", "tag": "29b20b5f-7957-4ca8-bd2e-f8da2057f3d3"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:16:51.295385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.295947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.296383 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.310501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] Creating event network-changed:29b20b5f-7957-4ca8-bd2e-f8da2057f3d3 for instance 4ba3f564-bb85-4a42-a420-3ea3811a814f on hv-cinder-85427 Sep 13 10:16:51.315612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-83768ac7-94f4-4033-bad9-3e10a5eddcaa req-64d768e4-2c68-49b2-a817-b91d27da8782 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034521 Sep 13 10:16:51.316320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 72/149] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:16:51.785688 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:51.785688 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:51.793976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.794488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.794917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.795647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.796108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.796547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.859260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:51.862648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:51.873751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.874283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.874680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.875131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lazy-loading 'fault' on Instance uuid f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:16:51.887362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.890521 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.891232 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.892868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:51.894696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:51.896932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:51.951774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6855123d0740aba728a2379419cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30beae855402476b9e1e542be6cc7e88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:51.960458 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-37eca2b2-cfa5-43c7-af0e-aa93dbaf4edd tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 200 len: 1351 microversion: 2.1 time: 0.179463 Sep 13 10:16:51.961038 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 78/150] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:51 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 1351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:52.231432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:52.234605 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:52.236910 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:52.246583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-89f74e60-82d3-42ae-bcb5-8fcfeb947bda tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.402395 Sep 13 10:16:52.246702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:52.246702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:52.246702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:52.247500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:52.248343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:52.248918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:52.266508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 73/151] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:51 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:52.421753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:52.429700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8c7e3fff-934f-425b-943a-8a0a9adfb5bd tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.199668 Sep 13 10:16:52.430268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 79/152] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:52 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:52.983923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:52.984544 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:52.988283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:52.989200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=6 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:52.994916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:52.995450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:52.995892 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:52.996741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:52.997384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:52.998190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.015620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] HTTP exception thrown: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Request method failure captured: Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 HTTP/1.1 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhOrzii1r9otXGEPjrcFCHWgi4rvMQ0ieeVUU5-TphiCklIh6u04cQt1S0XUgZel6wex-bTXf_iTAUmis2kXC8XXRr4EHTsn3gZK4MOVertWi2pASC8DPFSexsTdm52Zsgub4hJzwVHRuQEq6tEPj0eMPUsuvjqeVWwJa9N0ol0RsM Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:16:53.019283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30beae855402476b9e1e542be6cc7e88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: ca6855123d0740aba728a2379419cc95 Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.020500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1'} Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:16:53.022255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.023391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.024399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Returning 404 to user: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:16:53.024399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-855f2504-0ffc-408b-be72-8ba1d2605c1f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 404 len: 111 microversion: 2.1 time: 0.041152 Sep 13 10:16:53.024399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 74/153] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:52 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:16:53.167999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:53.170233 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:53.176282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.176762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.177192 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.177869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.178320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.178739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.191916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] HTTP exception thrown: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Request method failure captured: Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1/os-volume_attachments HTTP/1.1 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhOrzii1r9otXGEPjrcFCHWgi4rvMQ0ieeVUU5-TphiCklIh6u04cQt1S0XUgZel6wex-bTXf_iTAUmis2kXC8XXRr4EHTsn3gZK4MOVertWi2pASC8DPFSexsTdm52Zsgub4hJzwVHRuQEq6tEPj0eMPUsuvjqeVWwJa9N0ol0RsM Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:16:53.196817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30beae855402476b9e1e542be6cc7e88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: ca6855123d0740aba728a2379419cc95 Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.198307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'server_id': 'f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1'} Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:16:53.203138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:53.205165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:53.206491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Returning 404 to user: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:16:53.206491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-015c7c07-eed3-48ed-a8d9-04c62e3ed96f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034246 Sep 13 10:16:53.206491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 80/154] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:16:53 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:16:53.276329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:53.276994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:53.289608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.291801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.292269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.292999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.293462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.294237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.432761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:53.440636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f76b223e-cf0e-4f8e-b8fb-f037cb77c90f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.175160 Sep 13 10:16:53.441196 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 75/155] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:53 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:53.454322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:53.455726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:53.471067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.471067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.471067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.471067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:53.471469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:53.471469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:53.594601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:53.608438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-80c98b8b-678d-42b3-b4c5-40129eb932c6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.158922 Sep 13 10:16:53.618316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 81/156] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:53 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:54.466456 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:54.467071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:54.476576 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:54.479622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:54.479622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:54.479622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:54.479622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:54.480061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:54.644588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:54.645751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:54.650662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:54.652590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:54.653074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:54.659125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:54.659125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:54.659125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:54.659125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:54.667808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:54.681331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-768b5529-515b-4043-816c-06d2dfd28cbd tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.218851 Sep 13 10:16:54.682432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 76/157] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:54 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:54.811423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:54.813751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:54.819989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5e034357-be82-401f-98b9-9dd7261d4c7a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.188271 Sep 13 10:16:54.820564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 82/158] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:54 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:16:55.704289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:55.704904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:55.711545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.712032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.712565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.713260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.713713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.714242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.788024 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:55.794099 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:55.798590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.802631 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.803076 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.803993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.804751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.805003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.819605 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] HTTP exception thrown: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Request method failure captured: Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 HTTP/1.1 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhOrzii1r9otXGEPjrcFCHWgi4rvMQ0ieeVUU5-TphiCklIh6u04cQt1S0XUgZel6wex-bTXf_iTAUmis2kXC8XXRr4EHTsn3gZK4MOVertWi2pASC8DPFSexsTdm52Zsgub4hJzwVHRuQEq6tEPj0eMPUsuvjqeVWwJa9N0ol0RsM Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:16:55.822929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30beae855402476b9e1e542be6cc7e88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: ca6855123d0740aba728a2379419cc95 Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.824236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1'} Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:16:55.825046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.826257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.828962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Returning 404 to user: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:16:55.830565 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-43884b2c-6539-4ab6-828d-afbf72f52b0f tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 404 len: 111 microversion: 2.1 time: 0.049209 Sep 13 10:16:55.831735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 83/159] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:16:55 2022] DELETE /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 10:16:55.850253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:55.851050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] [instance: f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:55.858564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.859271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.859940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.861282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.862020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.862322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.880480 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] HTTP exception thrown: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Request method failure captured: Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 HTTP/1.1 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhOrzii1r9otXGEPjrcFCHWgi4rvMQ0ieeVUU5-TphiCklIh6u04cQt1S0XUgZel6wex-bTXf_iTAUmis2kXC8XXRr4EHTsn3gZK4MOVertWi2pASC8DPFSexsTdm52Zsgub4hJzwVHRuQEq6tEPj0eMPUsuvjqeVWwJa9N0ol0RsM Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:16:55.882735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30beae855402476b9e1e542be6cc7e88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30beae855402476b9e1e542be6cc7e88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 30beae855402476b9e1e542be6cc7e88 Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-DeleteServersTestJSON-2141756802 Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: ca6855123d0740aba728a2379419cc95 Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-DeleteServersTestJSON-2141756802-project Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.887382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1'} Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:16:55.888365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. Sep 13 10:16:55.889713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:16:55.890956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] Returning 404 to user: Instance f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:16:55.890956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-407f2d00-e952-4fb7-a2c5-c6b75f2afd00 tempest-DeleteServersTestJSON-2141756802 tempest-DeleteServersTestJSON-2141756802-project] 10.222.0.62 "GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1" status: 404 len: 111 microversion: 2.1 time: 0.038491 Sep 13 10:16:55.890956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 84/160] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:55 2022] GET /compute/v2.1/servers/f8d6a0e2-f4d5-48ee-aa58-ebdab537b0e1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:16:55.903572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:55.904056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:55.904227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:55.911243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.911687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.912124 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:55.912877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:55.913740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87b832a1-cd12-4cb2-9280-d9860726c4ab tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.212853 Sep 13 10:16:55.914752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 77/161] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:55 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:55.923508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:55.924349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:56.082332 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:56.091252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e94de79e-fb3f-480b-8068-831ae00ff8f4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.204774 Sep 13 10:16:56.091955 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 85/162] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:55 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:56.936780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:56.938677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:56.945430 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:56.945919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:56.946386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:56.947047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:56.948490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:56.948490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:57.114064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:57.114684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:57.131089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:57.131089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:57.131089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:57.131089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:57.131555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:57.131555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:57.170078 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:57.183317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-75f5c037-908f-4772-94d4-f1a63fd3fe80 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.249056 Sep 13 10:16:57.185800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 78/163] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:56 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:57.326436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:57.335687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-148d2b40-ccca-44d2-aed2-2ce7f37386b7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.225209 Sep 13 10:16:57.338876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 86/164] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:57 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:58.206785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:58.207423 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:58.217283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:58.218123 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:58.218563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:58.226008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:58.231984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:58.231984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:58.360543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:58.361832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:58.368573 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:58.369326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:58.369997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:58.370900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:58.371442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:58.371847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:58.489001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:58.497652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ac5f7312-2544-49de-90e8-b274c7505378 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.295590 Sep 13 10:16:58.498365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 79/165] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:58 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:58.871250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:58.881724 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-eca40c8b-1b2f-458c-a5c6-4dd651edf56e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.525356 Sep 13 10:16:58.900825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 87/166] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:58 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:59.521907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:59.522628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:59.529278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:59.530653 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:59.531157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:59.532419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:59.533309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:59.533758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:59.550661 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:16:59.753682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:16:59.761715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-60702c22-839d-43b8-90ad-838e974d3898 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.243732 Sep 13 10:16:59.762286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 80/167] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:59 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:16:59.913634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:16:59.914244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:16:59.920411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:59.920889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:59.921488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:16:59.922762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:16:59.923244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:16:59.923670 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:00.123918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:00.133367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3838d236-a9dc-40e7-80cf-2b81be7ddfdb tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.231306 Sep 13 10:17:00.134137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 88/168] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:16:59 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:00.785559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:00.786097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:00.793218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:00.793716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:00.794179 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:00.794845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:00.795316 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:00.795735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:00.925236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:00.932712 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ab973340-efd5-4ae7-b49e-60a31698fcf4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.151491 Sep 13 10:17:00.933297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 81/169] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:00 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:01.158455 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:01.159065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:01.164921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:01.165407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:01.165839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:01.166530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:01.166984 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:01.170183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:01.311453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:01.321691 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-02f9934e-5726-45d2-8122-555132d79fc9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.167840 Sep 13 10:17:01.322311 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 89/170] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:01 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:01.956469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:01.956972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:01.963868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:01.964364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:01.964772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:01.965454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:01.965899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:01.966506 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:02.096193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:02.104057 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-567cfbb2-6ce5-4ae3-a0f0-310bd4027e7d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.152170 Sep 13 10:17:02.104621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 82/171] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:01 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:02.344677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:02.345481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:02.351977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:02.352468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:02.353007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:02.353701 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:02.354147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:02.354567 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:02.500607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:02.508620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-507089f9-8114-4a02-82cf-fc4331347986 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.168078 Sep 13 10:17:02.509354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 90/172] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:02 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:03.126513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:03.131636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:03.133989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:03.134478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:03.134927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:03.135646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:03.136091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:03.136511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:03.351348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:03.355636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-964120a3-a970-4f4d-bb50-52d4c8941d12 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.232875 Sep 13 10:17:03.370957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 83/173] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:03 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:03.532349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:03.533329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:03.539470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:03.540121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:03.540548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:03.541286 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:03.541882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:03.542664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:03.695090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:03.704049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-829d06d8-afda-4e59-95cf-cc2e75b89434 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.175109 Sep 13 10:17:03.704687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 91/174] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:03 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:04.345093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba3f564-bb85-4a42-a420-3ea3811a814f", "name": "network-vif-plugged", "status": "completed", "tag": "29b20b5f-7957-4ca8-bd2e-f8da2057f3d3"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:04.357132 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:04.357856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:04.360115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:04.370946 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] Creating event network-vif-plugged:29b20b5f-7957-4ca8-bd2e-f8da2057f3d3 for instance 4ba3f564-bb85-4a42-a420-3ea3811a814f on hv-cinder-85427 Sep 13 10:17:04.380869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:04.381722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:04.393263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-2de571ff-1f26-4574-b337-342afd739123 req-81e128b3-3095-4241-a2e3-a46c0990a656 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052472 Sep 13 10:17:04.395929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:04.396440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:04.396874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:04.397310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 84/175] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:04.398640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:04.399771 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:04.400356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:04.751608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:04.751608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0420f0fb-76b0-49cc-bb0e-f2b60c686881 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.249221 Sep 13 10:17:04.751608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 92/176] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:04 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:04.754310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:04.754310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:04.754310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:04.754310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:04.756290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:04.756290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:04.756290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:04.756290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:04.974135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:04.990396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ca263a12-d442-4010-ae8b-ff9ad7c5d4a1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.265677 Sep 13 10:17:04.991255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 85/177] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:04 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:05.764538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:05.765222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:05.773711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:05.774199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:05.774633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:05.777221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:05.779314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:05.780377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:06.012836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:06.014495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:06.015239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:06.024342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:06.024342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:06.024342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:06.024629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:06.025163 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:06.025823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:06.027134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2d7390a8-225b-4c3d-9a4a-a57ce6802f1f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1313 microversion: 2.1 time: 0.266441 Sep 13 10:17:06.027763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 93/178] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:05 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:06.234209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:06.245681 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e26a4f34-32a2-4172-836c-d8900791e8d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.235484 Sep 13 10:17:06.249006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 86/179] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:06 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:07.051745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:07.051745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:07.073678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:07.074788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:07.077408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:07.078362 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:07.080222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:07.081310 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:07.271884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:07.273211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:07.293800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:07.294753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:07.295701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:07.297508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:07.297992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:07.299032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:07.344528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:07.350434 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d89ee9ea-ec2c-4c67-8d83-c1ffe61dde29 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1497 microversion: 2.1 time: 0.304198 Sep 13 10:17:07.378860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 94/180] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:07 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:07.538079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:07.565051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7c95fae0-1a2c-4a08-89c3-3056c7498996 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.296479 Sep 13 10:17:07.566022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 87/181] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:07 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:08.517136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:08.517136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:08.525405 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.525891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.526319 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:08.527096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.527613 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.528547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:08.568441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:17:08.595936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:08.597106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:08.607730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.614590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.625069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:08.625069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.625069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.625069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:08.914761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:08.925802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b8eb29ff-d2a5-463e-9640-8d77797a9f07 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 204 len: 0 microversion: 2.1 time: 0.413226 Sep 13 10:17:08.926393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 95/182] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:17:08 2022] DELETE /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:17:08.940446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-11279554-ccbc-462b-a88d-e537441fb330 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.349106 Sep 13 10:17:08.944188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:08.945115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:08.945923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 88/183] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:08 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:08.959344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.964199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.965714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:08.966611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:08.970484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:08.971226 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:09.272967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:09.281122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-73ee9a9e-d1c1-4bbb-aab9-9ecbb61d9004 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1503 microversion: 2.1 time: 0.349078 Sep 13 10:17:09.283053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 96/184] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:08 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:09.866706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1a9d5571-b1cb-4fa9-b924-8cd3d0f3b53e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: .version_select at 0x7f46c130cee0>, body: {"keypair": {"name": "tempest-keypair-943774531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL2ZZat6kMIcmdGE2ZQngNFc/eKs0uGNAVvL8WW3JsJBBHXEnwRtD3z2fHZXd09xEqPnipOOb+iAW0gf1kCW2EIil11Heh2zfq4fCKR/SFZK7hU0ARJRDhVpb113dGnoA=="}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:09.885090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-1a9d5571-b1cb-4fa9-b924-8cd3d0f3b53e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for project c9aaa16702a5422b90578033420da9bd. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:09.897991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-1a9d5571-b1cb-4fa9-b924-8cd3d0f3b53e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for user 90f07b101240464387f3fbf92c925ec7 and project c9aaa16702a5422b90578033420da9bd. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:09.977419 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:09.979078 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:09.989023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:09.989529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:09.989977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:09.990691 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:09.991148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:09.991602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:10.080103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1a9d5571-b1cb-4fa9-b924-8cd3d0f3b53e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.405692 Sep 13 10:17:10.081758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 89/185] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:17:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:10.170318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:10.180270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-17bc53db-d0db-4169-94e6-9b595b33e7d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.209743 Sep 13 10:17:10.181220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 97/186] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:09 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:10.307197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:10.309933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:10.316936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:10.318260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:10.318914 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:10.320351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:10.321080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:10.322165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:10.492519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:10.518245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-19fd725f-9ce8-4ca3-8336-46512836b386 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1503 microversion: 2.1 time: 0.216454 Sep 13 10:17:10.518840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 90/187] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:10 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:11.211524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:11.211524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:11.224258 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:11.224915 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:11.225521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:11.226231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:11.226827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:11.227446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:11.432770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:11.444913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba3f564-bb85-4a42-a420-3ea3811a814f", "name": "network-vif-deleted", "tag": "29b20b5f-7957-4ca8-bd2e-f8da2057f3d3"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:11.457986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4df1e85c-8ea2-4965-b14a-b565134e03ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.256365 Sep 13 10:17:11.463364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 98/188] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:11 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:11.463520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:11.463520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:11.463520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:11.479732 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] Creating event network-vif-deleted:29b20b5f-7957-4ca8-bd2e-f8da2057f3d3 for instance 4ba3f564-bb85-4a42-a420-3ea3811a814f on hv-cinder-85427 Sep 13 10:17:11.486119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-0477d65f-941b-416d-bffe-4ec7762aca6c req-7b4e2b10-7fcf-438e-852c-3e37ffa334d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045076 Sep 13 10:17:11.486927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 91/189] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:11.543265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:11.543804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:11.550213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:11.550719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:11.551198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:11.551919 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:11.552378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:11.552802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:11.557941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:11.671413 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:11.681074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ff2cd4df-3d20-4438-b2d5-21766f1d8151 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1461 microversion: 2.1 time: 0.141793 Sep 13 10:17:11.687854 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 99/190] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:11 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1461 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:12.330538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-868967110", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:12.402118 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] validate_networks() for None {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:17:12.481970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:12.486458 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:12.494320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:12.494866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:12.496084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:12.497150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:12.497831 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:12.498450 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.111874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:13.120667 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d9792f74-9ec6-43a0-a21e-6beb90e42e6d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.643175 Sep 13 10:17:13.135112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 100/191] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:12 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:13.135112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:13.135112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:13.135112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:13.135112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:13.135934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.135934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:13.135934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:13.135934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.206372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:17:13.206948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:17:13.207587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:17:13.207999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:17:13.208404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:17:13.219671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:13.220432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:13.221725 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.222560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lazy-loading 'fault' on Instance uuid 4ba3f564-bb85-4a42-a420-3ea3811a814f {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:13.225699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:13.230466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:13.230466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.230466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:13.230466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:13.231033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:13.259605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Getting quotas for project e9655193b10a47e6ba071e70d0d8b7aa. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:13.263861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Getting quotas for user 981d5bb01b35421ba8afe0df824ba5f6 and project e9655193b10a47e6ba071e70d0d8b7aa. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:13.270484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:13.276198 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:17:13.282394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:17:13.282489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-465fa6cd-b3bb-4269-ae21-b46c02a4fa3e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 200 len: 1303 microversion: 2.1 time: 0.156557 Sep 13 10:17:13.282489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 101/192] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:13 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:13.459395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1334613283", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebff5e7b-2242-4a30-a2b5-9e7b0fe34011"}], "security_groups": [{"name": "tempest-securitygroup--566206000"}], "key_name": "tempest-keypair-943774531", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:13.531473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ee31a017-95e0-4cb5-8d29-b366cb74836c tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201184 Sep 13 10:17:13.532242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 92/193] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:17:13.533568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:13.545514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e753ffa2-c378-4a8b-b030-e04b38fcb86d tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:13.547242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e753ffa2-c378-4a8b-b030-e04b38fcb86d tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:13.690403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e753ffa2-c378-4a8b-b030-e04b38fcb86d tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:13.698455 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e753ffa2-c378-4a8b-b030-e04b38fcb86d tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1214 microversion: 2.1 time: 0.159009 Sep 13 10:17:13.699052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 93/194] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:13 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:13.722823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] validate_networks() for [('ebff5e7b-2242-4a30-a2b5-9e7b0fe34011', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:17:14.147106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:14.148113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:14.161019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.161913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.164789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.165584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.166087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.167318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.194971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:17:14.195760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:17:14.195886 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:17:14.196293 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:17:14.196733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:17:14.209777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.210260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.210683 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.211652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.212096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.212513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.230641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for project c9aaa16702a5422b90578033420da9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:14.235348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for user 90f07b101240464387f3fbf92c925ec7 and project c9aaa16702a5422b90578033420da9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:14.254230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:17:14.256546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:17:14.312049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:14.320556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fd037b92-9546-485c-88a5-32cb21ba3932 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.177516 Sep 13 10:17:14.321583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 94/195] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:14 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:14.326236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:14.326819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 4ba3f564-bb85-4a42-a420-3ea3811a814f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:14.333481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.334160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.334608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.335345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.335820 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.336260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.350699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] HTTP exception thrown: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Request method failure captured: Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f HTTP/1.1 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFiFqwGiMoCE4EuU-JDFNL7I6iqFij2y7rWZkY1pf3HwqMXVZqBcX3cPNCHZWnMnAscPq4QuxakQe-oEwWaOJ5Jn0N_zYPbky9to5CKjNemtBBRf4gwNhhe-cx8ooTcc2x_eQAvlXIyHQmz8_3SDFFwbtIGL2-piv-Q5bVjjtlus8O0 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 723137b6e4764ec6b58b46f84a05a37e Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:17:14.352372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 723137b6e4764ec6b58b46f84a05a37e Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesActionsTest-1501221289-project Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 6c886285823a45a0b921a180d5bf4f1e Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesActionsTest-1501221289-project Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. Sep 13 10:17:14.353738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '4ba3f564-bb85-4a42-a420-3ea3811a814f'} Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:17:14.354454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. Sep 13 10:17:14.355655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:14.356831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Returning 404 to user: Instance 4ba3f564-bb85-4a42-a420-3ea3811a814f could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:17:14.356831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b4c989d1-bf4b-4634-8b45-9bdbf7910002 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f" status: 404 len: 111 microversion: 2.1 time: 0.031210 Sep 13 10:17:14.356831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 95/196] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:14 2022] GET /compute/v2.1/servers/4ba3f564-bb85-4a42-a420-3ea3811a814f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:17:14.410760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6a0fd486-bc49-4ee4-9b14-7e9601afc53d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.955674 Sep 13 10:17:14.411718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 102/197] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:17:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:17:14.423702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-28f08459-8406-46f2-b28a-b9a558240376 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:14.424958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-28f08459-8406-46f2-b28a-b9a558240376 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:14.470570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1753497347", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "networks": [{"uuid": "b640de2f-1d12-4bb4-bb69-1af7b73e7f86"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:14.515821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-28f08459-8406-46f2-b28a-b9a558240376 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:14.526095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-28f08459-8406-46f2-b28a-b9a558240376 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1237 microversion: 2.1 time: 0.106993 Sep 13 10:17:14.526672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 96/198] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:14 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:14.547153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] validate_networks() for [('b640de2f-1d12-4bb4-bb69-1af7b73e7f86', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:17:14.724353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d40fa9b9-5019-4ee8-bff5-b3fc688a6a29 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:14.724960 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d40fa9b9-5019-4ee8-bff5-b3fc688a6a29 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:14.822303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d40fa9b9-5019-4ee8-bff5-b3fc688a6a29 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:14.830286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d40fa9b9-5019-4ee8-bff5-b3fc688a6a29 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1214 microversion: 2.1 time: 0.109721 Sep 13 10:17:14.830858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 97/199] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:14 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:14.971491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:17:14.971491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:17:14.971491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:17:14.971491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:17:14.971491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:17:14.981438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.982751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.983389 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:14.985036 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:14.985646 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:14.986835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:15.008735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Getting quotas for project 723137b6e4764ec6b58b46f84a05a37e. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:15.013917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Getting quotas for user 6c886285823a45a0b921a180d5bf4f1e and project 723137b6e4764ec6b58b46f84a05a37e. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:15.033763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:17:15.036052 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:17:15.201740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f83cf64d-832a-4532-8b51-0306c27d737e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735963 Sep 13 10:17:15.202560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 103/200] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:17:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:17:15.215116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-21449387-0801-4be0-a11e-9cf1cd589865 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:15.219716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-21449387-0801-4be0-a11e-9cf1cd589865 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:15.272040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-21449387-0801-4be0-a11e-9cf1cd589865 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:15.278868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-21449387-0801-4be0-a11e-9cf1cd589865 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1214 microversion: 2.1 time: 0.068675 Sep 13 10:17:15.279726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 98/201] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:15 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:15.348408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:15.349083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:15.356309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:15.356908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:15.357545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:15.358312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:15.358763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:15.359459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:15.506518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:15.518786 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5cf88cee-98a1-4ddd-9c28-c0be67e3b7aa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1521 microversion: 2.1 time: 0.174480 Sep 13 10:17:15.519422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 104/202] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:15 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:15.552840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0108c397-fb70-49b9-8462-bb88aab7a722 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:15.553611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0108c397-fb70-49b9-8462-bb88aab7a722 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:15.631320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0108c397-fb70-49b9-8462-bb88aab7a722 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:15.639924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0108c397-fb70-49b9-8462-bb88aab7a722 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1237 microversion: 2.1 time: 0.091717 Sep 13 10:17:15.643231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 99/203] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:15 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:15.852988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:15.853720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:15.860888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:15.861366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:15.861790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:15.862476 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:15.862942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:15.863384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:15.948021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:15.960029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-53cae4cf-33d2-4ae0-86dd-1755144aee8b tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1210 microversion: 2.1 time: 0.110687 Sep 13 10:17:15.961696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 105/204] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:15 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:16.302397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:16.311289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:16.321708 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.322204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.322740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.323441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.323861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.324288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.389272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:16.398864 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-db3ac717-a3cd-4430-851c-5985d607aac5 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1218 microversion: 2.1 time: 0.100860 Sep 13 10:17:16.399491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 100/205] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:16 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:16.548026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:16.548638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:16.555137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.557101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.557101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.558154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.558593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.559026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.666206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:16.667831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:16.670236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:16.676556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.677097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.678729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.678729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.678981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.679336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.788705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:16.815134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b84d34bd-36b0-4e97-8595-3f97bc622fd1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1501 microversion: 2.1 time: 0.271359 Sep 13 10:17:16.815751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 106/206] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:16 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1501 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:16.838717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:16.839650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:16.849395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.850165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.850813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.851795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.852368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.852856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.963037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:16.971919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-39d68eb0-cc26-411f-b0da-17d9ee09c5a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1233 microversion: 2.1 time: 0.312663 Sep 13 10:17:16.973041 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 101/207] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:16 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1233 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:16.987665 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:16.988381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:16.994640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.995133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.995640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:16.996337 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:16.996794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:16.997341 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:17.046243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:17.054422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-79e00cff-3bd2-4084-9e0a-7080e82d9901 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1515 microversion: 2.1 time: 0.220108 Sep 13 10:17:17.054999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 107/208] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:16 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:17.087415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:17.096646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7ae525b9-44ee-4238-a03e-f62983c108b8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1266 microversion: 2.1 time: 0.116912 Sep 13 10:17:17.108699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 102/209] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:16 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:17.424788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:17.425521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:17.442218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:17.445752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:17.447658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:17.448761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:17.450138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:17.452916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:17.550781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:17.558594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1bb8c650-2e0b-4dd8-bb01-cd7902c89f9d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1210 microversion: 2.1 time: 0.140060 Sep 13 10:17:17.559178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 108/210] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:17 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:17.996659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:17.997296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:18.005122 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.005557 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.005999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.006697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.007266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.007751 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.070351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:18.082377 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bd9438a9-9653-4761-b369-a3585fb6e8cf tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1289 microversion: 2.1 time: 0.089655 Sep 13 10:17:18.082965 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 103/211] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:17 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:18.121323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:18.122185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:18.129308 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.130039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.130487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.131195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.131794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.132497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.227996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:18.236596 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2d207d93-11d7-4017-9026-6a4b9e408889 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1272 microversion: 2.1 time: 0.119496 Sep 13 10:17:18.237386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 109/212] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:18 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:18.590139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:18.593424 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:18.605136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.605636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.606080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.606795 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.607509 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.607798 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.722800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:18.737075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-10ddaf05-f19d-4ee9-af2c-aa65f07a07dc tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1266 microversion: 2.1 time: 0.158855 Sep 13 10:17:18.737652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 104/213] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:18 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:18.929874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:18.935386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:18.943039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.943666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.944117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.944846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:18.945307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:18.945734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:18.978898 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'flavor' on Instance uuid cc04ffd6-17d2-4446-9a30-5bf651dd5a3f {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:19.108387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:19.109270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:19.115731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.116298 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.116810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:19.117654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.118188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.118687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:19.145073 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:19.314077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d36afbd7-941f-49b9-b1c5-d9fa2637e649 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/action" status: 200 len: 32 microversion: 2.1 time: 0.388501 Sep 13 10:17:19.322087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 110/214] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:17:18 2022] POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:17:19.363341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:19.364537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:19.374155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.379539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.379539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:19.379539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.379539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.380163 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:19.728753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:19.737046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6d6da5f5-3035-4d51-9e1a-ff5b5a7671fb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.632442 Sep 13 10:17:19.748083 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 105/215] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:19 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:19.753249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:19.753829 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:19.773756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.774487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.775327 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:19.776338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:19.777218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:19.777885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:20.019569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:20.030323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b0ea448a-f849-49d2-8082-11a395c4c6fc tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.711850 Sep 13 10:17:20.043196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 111/216] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:19 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:20.043196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:20.043196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:20.051050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:20.051050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:20.051050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:20.051050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:20.051361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:20.051361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:20.156903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:20.162614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:20.168164 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c4dd8f09-46b7-4000-8b38-60dbb5aa9e82 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.418924 Sep 13 10:17:20.184357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 106/217] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:19 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:20.184498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5621099e-51b9-424e-bd0f-2f0bee4ef4b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1272 microversion: 2.1 time: 0.137705 Sep 13 10:17:20.184498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 112/218] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:20 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:20.454024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f3dda9-b22b-462e-8654-72dd969ed185", "tag": "dd3f05c9-e47e-47e5-8f9e-7edf993cb796"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:20.465177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:20.466029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:20.466674 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:20.483486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] Creating event network-changed:dd3f05c9-e47e-47e5-8f9e-7edf993cb796 for instance a2f3dda9-b22b-462e-8654-72dd969ed185 on hv-cinder-85427 Sep 13 10:17:20.494330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-271caa60-62df-423d-bf16-0b2dbec5615c req-54f7f8ed-f5e4-47c9-bfa0-45bbefcd73d7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044363 Sep 13 10:17:20.495403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 107/219] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:20.770546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:20.771154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:20.777707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:20.778445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:20.783991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:20.783991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:20.783991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:20.783991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.058772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:21.059623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:21.084926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.087389 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.088340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.089413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.090366 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.090969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.271021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:21.292711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2a5fb3da-40f1-4e5f-b683-78458654117c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.523873 Sep 13 10:17:21.295402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 113/220] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:20 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:21.301682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:21.303104 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:21.313143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.313874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.314533 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.315491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.316146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.316765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.526048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:21.534293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ec8d62d2-16f0-4f8e-a39b-92df9b55dc01 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.480171 Sep 13 10:17:21.534870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 108/221] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:21 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:21.540454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:21.541423 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:21.555004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.555569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.556003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.556939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:21.557421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:21.557938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:21.708540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:21.710906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:21.717690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2cf6df81-2986-4cee-aef6-debda0652e77 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.420918 Sep 13 10:17:21.718313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 114/222] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:21 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:21.775237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:21.783426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3d501d20-6592-43a1-ace1-0bfdbbcdfbb4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.247467 Sep 13 10:17:21.786373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 109/223] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:21 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:22.021246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ac518-daa6-4685-91e9-db203b8dafe4", "tag": "29f0b49b-c442-4029-ab17-b8c8e27031dc"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:22.032128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.032760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.033225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.044551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] Creating event network-changed:29f0b49b-c442-4029-ab17-b8c8e27031dc for instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 on hv-cinder-85427 Sep 13 10:17:22.049967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-527ad857-f398-4f0b-a44a-8bc2473a2b89 req-6ded64b9-c4fd-4100-84a9-4e0bcc83ed66 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Sep 13 10:17:22.050843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 115/224] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:22.322194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:22.322717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:22.329488 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.329942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.330353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.331091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.331577 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.334496 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.493348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:22.501380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-57c0c8aa-cb71-4cb5-b849-bd9a7bedfe06 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.183214 Sep 13 10:17:22.501945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 110/225] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:22 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:22.558186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:22.558891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:22.567579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.568366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.568806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.569511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.569971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.570396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.743580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:22.744792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:22.750927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.751810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.752264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:22.753011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:22.753474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:22.753905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:23.060442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:23.069610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-35a8ef74-9330-4d0d-a5f0-e8051c27a5a8 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.516000 Sep 13 10:17:23.070314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 116/226] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:22 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:23.089891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:23.090580 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:23.096642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:23.105065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:23.105065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:23.105065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:23.105065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:23.105523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:23.246566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:23.262810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:23.270820 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-af314ecf-e080-4be3-a82d-920baa0324d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.532389 Sep 13 10:17:23.271427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 111/227] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:22 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:23.477763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:23.486993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-05600461-95b0-42b8-ae8c-d9018a700735 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.405391 Sep 13 10:17:23.487877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 117/228] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:23 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:23.525710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:23.526840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:23.534885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:23.535637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:23.536054 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:23.536912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:23.537363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:23.538043 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.019224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:24.028671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d340ecc0-7089-43a3-86ce-3b1c0581f4a6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.507537 Sep 13 10:17:24.044483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 112/229] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:23 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:24.096191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:24.096791 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:24.102826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.103338 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.103760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.104441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.104887 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.105303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.301340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:24.302349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:24.313887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.314800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.315480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.316518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.317182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.317837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.406305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:24.420297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4aa64863-2b59-4015-9bf8-a4a9bd1a1505 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.328072 Sep 13 10:17:24.421795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 118/230] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:24 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:24.510529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:24.511790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:24.520264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.520982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.521992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.522773 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.523492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.524072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.565910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:24.575587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b8c92d4f-1917-4700-92ad-59314c172cbc tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.283870 Sep 13 10:17:24.578725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 113/231] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:24 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:24.723406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:24.733820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a36f28b1-3bf5-427e-9fb7-16148ad24c23 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.227926 Sep 13 10:17:24.734597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 119/232] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:24 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:24.829687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dfac68f-b013-4c67-949c-d1fd909bb3e5", "tag": "8da7e5cd-29ef-4dce-b867-35c3a5b93ab8"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:24.839881 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:24.840434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:24.840932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:24.854497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] Creating event network-changed:8da7e5cd-29ef-4dce-b867-35c3a5b93ab8 for instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 on hv-cinder-85427 Sep 13 10:17:24.859385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-af605b37-5597-45a0-8732-8ab5ed897a92 req-2fcb3f20-1ef4-4fa3-96ef-d373af9c1119 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033899 Sep 13 10:17:24.859966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 114/233] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:25.052107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:25.052720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:25.054660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:25.055542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=12 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:25.060378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.060864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.061306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.062571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.063107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.063559 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.202350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:25.210911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dfbc1430-3bb1-4b5f-b774-3b07e8291a61 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.162689 Sep 13 10:17:25.211875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 120/234] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:25 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:25.444604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:25.445222 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:25.451510 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.451994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.452947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.453630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.454082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.454507 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.588890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:25.597960 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8ac0f3e4-5ad5-4c7f-8f0c-ee1a5fd62a1a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.157604 Sep 13 10:17:25.600558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 115/235] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:25 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:25.600665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:25.600893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:25.612032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.612556 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.612990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.613690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.614138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.614641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.758525 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:25.760080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:25.762180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=20 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:25.768413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.769426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.769923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.770703 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.771257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.771756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.784268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:25.793465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7129126e-0f95-45c4-896b-4f04171d983a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.197280 Sep 13 10:17:25.797306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 121/236] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:25 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:25.941664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:25.943539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:25.951775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.952889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.953346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.954053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:25.955127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:25.955675 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:25.968720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:25.977737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e9957066-1cff-4b5a-9777-85e40537ddf7 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.223276 Sep 13 10:17:25.978459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 116/237] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:25 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:25.989000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3228a96b-e8ad-47a1-bad8-0489e2a584fe tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/ips" status: 200 len: 152 microversion: 2.20 time: 0.052909 Sep 13 10:17:25.990127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 122/238] 10.222.0.62 () {60 vars in 1289 bytes} [Tue Sep 13 10:17:25 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:17:26.234580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:26.235593 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:26.241712 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.242605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.243259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.244346 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.245184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.245852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.516214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:26.516214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-745b0806-b076-45b9-885a-22622e940a86 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.242399 Sep 13 10:17:26.516214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 117/239] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:26 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:26.623827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:26.623827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:26.635131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.635749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.636295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.637064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.637593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.638110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.810986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:26.827680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c1369c7b-cb4c-49bc-8a22-f4064308ef19 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.204590 Sep 13 10:17:26.831541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:26.836253 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:26.843337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 123/240] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:26 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:26.850194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.851300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.852179 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.852920 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:26.853693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:26.854245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:26.999529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:27.007091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:27.013982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:27.021704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.024101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ae77f882-068d-453d-8816-994c292c6a34 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.192912 Sep 13 10:17:27.024787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 118/241] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:26 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:27.025089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.025612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:27.026348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.026809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.027352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:27.181717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:27.190033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-94a2e568-9ae3-442d-8298-55aea98d12b6 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.188143 Sep 13 10:17:27.190598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 124/242] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:27 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:27.497097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:27.497714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:27.504516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.506250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.506250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:27.506250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.506597 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.507013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:27.635200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:27.645929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-eec0783c-0843-472d-be1f-255ae2d72505 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.152702 Sep 13 10:17:27.646514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 119/243] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:27 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:27.856376 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:27.857229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:27.864191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.864669 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.865095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:27.865792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:27.866232 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:27.866646 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.010506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:28.020610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3de001fc-dc48-4e1f-be03-7182e637d91a tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.168189 Sep 13 10:17:28.021461 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 125/244] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:27 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:28.050264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:28.050759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:28.059833 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.061815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.061815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.062476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.063620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.064199 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.090673 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:28.090673 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:28.097796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b99c4a0b-07fc-4253-a2d0-78f49a41e5eb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/ips" status: 200 len: 148 microversion: 2.1 time: 0.051718 Sep 13 10:17:28.098878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 120/245] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:17:28 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/ips => generated 148 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:28.113653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.113653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.113653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.113653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.115532 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.116532 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.214030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:28.214703 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:28.221336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.221827 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.222308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.223061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.223705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.224282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.334325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:28.344315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2b0a4ea0-5b42-402d-9a22-25105411a78c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.267329 Sep 13 10:17:28.345041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 126/246] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:28 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:28.417211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:28.427329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-15da0d2a-3495-41be-b256-59f8dedad52e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.217262 Sep 13 10:17:28.428310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 121/247] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:28 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:28.477021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3dda9-b22b-462e-8654-72dd969ed185", "name": "network-vif-plugged", "status": "completed", "tag": "dd3f05c9-e47e-47e5-8f9e-7edf993cb796"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:28.487258 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.487838 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.488275 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.501942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] Creating event network-vif-plugged:dd3f05c9-e47e-47e5-8f9e-7edf993cb796 for instance a2f3dda9-b22b-462e-8654-72dd969ed185 on hv-cinder-85427 Sep 13 10:17:28.506982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-88801616-63cf-4e35-8747-28d3e9925a4d req-a6a2586d-c4b7-420b-8fe1-d0a26f0609b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Sep 13 10:17:28.507779 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 127/248] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:28.672677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:28.674050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:28.680470 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.680953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.681488 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.682195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.682662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.683089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.822035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:28.822652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:28.829841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.830339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.830771 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.831729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:28.832278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:28.837816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:28.861687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:28.867016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lazy-loading 'flavor' on Instance uuid 43a5958c-f83f-4303-bd83-8078154da9ac {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:28.872863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fdc73d50-5a8a-4cd9-a52e-786d21fe9390 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.204308 Sep 13 10:17:28.876492 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 122/249] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:28 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:29.074587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:29.075220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:29.082127 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.082611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.083068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.083782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.084233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.084662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.222912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.236388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:29.236388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-da73b4fc-cbbf-42a8-bf98-8c6647d8f2d0 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.160780 Sep 13 10:17:29.236388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 123/250] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:29 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:29.368150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:29.368800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:29.375288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.375779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.376217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.376916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.377399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.377816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-69ca20ed-6154-40f9-a32e-f991fbb75c21 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/action" status: 202 len: 0 microversion: 2.20 time: 0.572143 Sep 13 10:17:29.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 128/251] 10.222.0.62 () {62 vars in 1319 bytes} [Tue Sep 13 10:17:28 2022] POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:17:29.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:29.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:29.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.415951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.415951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.415951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.415951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.416484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.581091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.588769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87acffdf-be71-498e-9ef3-c8c63adcd13e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.224833 Sep 13 10:17:29.589505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 124/252] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:29 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:29.592110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.594175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:29.596654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:29.602203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.608781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.608781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-928b630f-e757-4fa9-b556-caf8996e30c0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.207882 Sep 13 10:17:29.608781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 129/253] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:29 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:29.609098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.609098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.609098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.609098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.609440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.609440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.745836 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:29.754700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-32796a17-a807-4741-8531-1d9c7fe57698 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.164033 Sep 13 10:17:29.755157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 125/254] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:29 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:29.902879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:29.903502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:29.909906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.910377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.910801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:29.911552 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:29.911999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:29.912417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.006782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1edb1e09-9405-4cf4-acba-bd825187d4ef"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:30.010730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:30.016339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.016830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.017300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.018007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.018473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.018899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.050464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.058984 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-41fa534e-8759-4ef5-b562-c51fe4fcf494 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.159964 Sep 13 10:17:30.059610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 130/255] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:29 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:30.257867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:30.258486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:30.265538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.266032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.266533 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.267460 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.268083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.268516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.272997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:30.432891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.439635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2cd9362f-5d99-456e-96cd-433cc32b646e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1314 microversion: 2.1 time: 0.186382 Sep 13 10:17:30.440408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 131/256] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:30 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:30.521069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ac518-daa6-4685-91e9-db203b8dafe4", "name": "network-vif-plugged", "status": "completed", "tag": "29f0b49b-c442-4029-ab17-b8c8e27031dc"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:30.530672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.531150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.532108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.542680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] Creating event network-vif-plugged:29f0b49b-c442-4029-ab17-b8c8e27031dc for instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 on hv-cinder-85427 Sep 13 10:17:30.548501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-6018aa66-b5c0-4893-8931-b80bd3a0854f req-f3175a04-af5c-43f2-8377-a03e92881ba2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Sep 13 10:17:30.549902 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 132/257] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:30.612560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:30.613423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:30.619628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.620536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.620536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.621227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.621682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.622111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.792947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.800836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c4c42bd1-0453-45b3-a4d0-a2616b386003 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.192455 Sep 13 10:17:30.801409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 133/258] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:30 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:30.805889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:30.806487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:30.812393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.812880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.813314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.814007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.814582 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.815012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.962979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.971996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.973500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:30.983349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d7a2c77e-fb28-4e02-94c9-7ccee581d652 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.172339 Sep 13 10:17:30.983349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 134/259] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:30 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:30.983349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:30.983349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:30.986726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.987228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.987666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:30.988354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:30.988809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:30.989246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.357020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:31.367002 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c4ad1b20-a04c-44c8-93cb-2cfea6f5e08c tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.390733 Sep 13 10:17:31.373474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 135/260] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:30 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:31.373474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:31.373474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:31.379391 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.379879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.380613 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.381387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.386936 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.387443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.543352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:31.552353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ea266a16-42c2-4549-a88f-968703945489 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.183688 Sep 13 10:17:31.552911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 136/261] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:31 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:31.559323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:31.559323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:31.560013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:31.565052 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.567272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.567272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.567272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.567272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.567749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.661350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e5e7dedc-8259-47d5-afb9-0309ec129616 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.662371 Sep 13 10:17:31.662135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 126/262] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:17:29 2022] POST /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments => generated 194 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:31.710328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:31.718167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-18f83387-84a0-4a01-bc07-6ac2505eeb68 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1464 microversion: 2.1 time: 0.164179 Sep 13 10:17:31.719414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 137/263] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:31 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:31.772089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:31.772700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:31.779035 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.779816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.780261 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.780969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.781957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.782384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.808145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:17:31.825246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:31.825854 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:31.833092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.833588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.834026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:31.834980 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:31.835540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:31.835968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.034769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.042575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-654f43cf-52f4-4f08-be50-c3350a58bfaa tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.222132 Sep 13 10:17:32.044369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 138/264] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:31 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:32.048454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:32.049072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:32.054478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.054981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.055612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.056474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.056951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.057343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.057793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5546ab79-04ef-4e3a-ae43-6a8223bcfe88 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 204 len: 0 microversion: 2.1 time: 0.289857 Sep 13 10:17:32.058448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 127/265] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:17:31 2022] DELETE /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:17:32.075359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:32.076408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:32.083267 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.083717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.084159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.084871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.085333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.085761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.301142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.311364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.313585 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.315617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bf7ea9c5-58ed-4258-8690-c4e68c8c263e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.271385 Sep 13 10:17:32.316457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 139/266] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:32 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:32.330674 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.339523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-58b647aa-5fc2-4dbc-96a4-136a36201260 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1470 microversion: 2.1 time: 0.268491 Sep 13 10:17:32.340114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 128/267] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:32 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:32.398498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:32.399471 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:32.407551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.408031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.408509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.409247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.409671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.410086 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.565903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.566855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f5f49f05-aa03-420d-8f62-0cf3638ee949 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.177212 Sep 13 10:17:32.567414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfac68f-b013-4c67-949c-d1fd909bb3e5", "name": "network-vif-plugged", "status": "completed", "tag": "8da7e5cd-29ef-4dce-b867-35c3a5b93ab8"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:32.577519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.578023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.579090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.579740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 140/268] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:32 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:32.588510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:32.600176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:32.601035 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] Creating event network-vif-plugged:8da7e5cd-29ef-4dce-b867-35c3a5b93ab8 for instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 on hv-cinder-85427 Sep 13 10:17:32.601035 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-c0b74caa-fcea-4803-a194-7fdcaf23b57f req-599084f4-9792-4df5-bc8d-ceea0425b5f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033225 Sep 13 10:17:32.601281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.601358 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 129/269] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:32.601439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.601439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.601439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:32.601439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:32.601723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:32.733047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:32.740919 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0960d6dc-6057-4c5b-b0ba-3504b5bd34d1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.160059 Sep 13 10:17:32.742820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 141/270] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:32 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:33.066899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:33.067638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:33.073870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.074432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.074886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.075602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.076064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.076489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.214998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.223497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b3a35aed-ffc4-456c-b9f0-f6f82d7e726b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.161416 Sep 13 10:17:33.224141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 130/271] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:33 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:33.342231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:33.343209 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:33.350728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.355846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.355846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.355846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.355846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.356174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.363936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:33.364545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:33.370810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.371401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.371846 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.372743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.373211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.373706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.584451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.588190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.593183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.595677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.601229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e5833b33-6828-4555-9ffb-c13792d1b6ab tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.258937 Sep 13 10:17:33.601229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 142/272] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:33 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:33.601419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-64d892e3-86d2-4e3f-92d7-b433824c3e04 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1470 microversion: 2.1 time: 0.238216 Sep 13 10:17:33.601419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 131/273] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:33 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:33.601955 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:33.602545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:33.612088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.612652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.613173 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.613933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.614445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.614935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.755882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.764042 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1c1e29ea-404c-400d-94bf-84d3a07c810d tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.165634 Sep 13 10:17:33.764615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 143/274] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:33 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:33.764988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:33.766145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:33.772418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.772919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.773353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.774116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:33.774578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:33.775002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:33.910587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:33.919388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ece10157-4ba5-46cc-b899-f5dc00985903 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1362 microversion: 2.1 time: 0.158333 Sep 13 10:17:33.920010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 132/275] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:33 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:34.248029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:34.249073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:34.255799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.256730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.257184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.258209 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.258697 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.259230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.399022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:34.408309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-49ddfe66-4653-4d1e-a01f-11a7e14c23ce tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.164391 Sep 13 10:17:34.408898 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 144/276] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:34 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:34.621971 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:34.622796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:34.623826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:34.624526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:34.629770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.630384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.630961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.631848 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.632538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.632651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.633026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.633292 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.634209 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.635015 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.635878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.642559 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.844178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:34.847301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:34.853842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6ef12357-4abb-479b-b8f4-61c6d7b38a15 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1470 microversion: 2.1 time: 0.236317 Sep 13 10:17:34.854689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 133/277] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:34 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:34.856935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:34.858432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:34.862407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2475f117-da8b-48cb-a6ed-13e1e3872780 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.240048 Sep 13 10:17:34.862515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:34.862515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:34.862669 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 145/278] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:34 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:17:34.870039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.870540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.871010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.872146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.872757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.873878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.943819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:34.943819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:34.951087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.951607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.952040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:34.952968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:34.953459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:34.953882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.159746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:35.168194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-57792d29-f7cc-4341-b877-2257769a84c1 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.312141 Sep 13 10:17:35.169007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 134/279] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:34 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:35.230559 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:35.239377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1fbb85ce-8431-46d8-8f20-0ef2f4337be8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1547 microversion: 2.1 time: 0.300449 Sep 13 10:17:35.239961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 146/280] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:34 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1547 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:35.267662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:35.268168 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:35.275085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.275637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.276063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.276777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.277242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.277669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.431144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:35.432537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:35.439328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.444489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.444489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.444489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.444489 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.444895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.705943 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-33304682-e0f7-4e2b-98c8-80731f63cd77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.447131 Sep 13 10:17:35.708382 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 135/281] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:17:35 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-interface => generated 284 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:35.885434 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:35.886328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:35.897025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.898058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.898570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.899629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.900324 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.900854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.912581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:35.925518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5b8dee2c-c2c7-47c0-96d3-40ac6acd64e5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.498256 Sep 13 10:17:35.943964 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 147/282] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:35 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:35.955399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:35.956276 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:35.968525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.969579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.970478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:35.971748 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:35.976040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:35.976966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.010108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:36.192270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:36.200404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-78e4de0f-fcb6-4ed6-b85d-225dcd24ea3e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1470 microversion: 2.1 time: 0.319023 Sep 13 10:17:36.200973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 136/283] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:35 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:36.209909 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:36.215390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:36.224352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.224905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.225348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.226113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.226612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.227097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.278144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:36.293147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:36.294970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:36.296176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-336dc8ca-fa6d-47a0-a7a6-3b2926f40d70 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.349713 Sep 13 10:17:36.312846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 148/284] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:35 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:36.419932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f3dda9-b22b-462e-8654-72dd969ed185", "name": "network-vif-deleted", "tag": "dd3f05c9-e47e-47e5-8f9e-7edf993cb796"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:36.434708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.441013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.441834 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.459186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] Creating event network-vif-deleted:dd3f05c9-e47e-47e5-8f9e-7edf993cb796 for instance a2f3dda9-b22b-462e-8654-72dd969ed185 on hv-cinder-85427 Sep 13 10:17:36.465690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-0deb4efa-0d7e-40f9-8df8-8c9f3ef05fad req-4f845ce7-3c25-48d3-9f1a-66a95a4ab8ff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059649 Sep 13 10:17:36.466412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 149/285] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:36.492030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:36.501997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-32b0b079-5689-4927-9153-b7d47c3af2f2 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.299658 Sep 13 10:17:36.503066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 137/286] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:36 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:36.844624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6ac518-daa6-4685-91e9-db203b8dafe4", "tag": "29f0b49b-c442-4029-ab17-b8c8e27031dc"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:36.854410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.854885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.855340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.866639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] Creating event network-changed:29f0b49b-c442-4029-ab17-b8c8e27031dc for instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 on hv-cinder-85427 Sep 13 10:17:36.871612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-cbdaee68-22df-467e-bf1b-258fdf4a6eb7 req-8e696bdc-c690-4792-ae05-b89162d8bff3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031668 Sep 13 10:17:36.877824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 150/287] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:36.952512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:36.954592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:36.961072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.961552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.962039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.962735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:36.963206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:36.963628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:36.981975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:37.106147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.114658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ebf07609-c51e-4b4e-b202-8c7563452c48 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.166648 Sep 13 10:17:37.115277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 138/288] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:36 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:37.227002 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:37.229590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:37.236597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.237319 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.238268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.242940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.243690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.244127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.324700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:37.325623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:37.334702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.335321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.335982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.336123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.336789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.337318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.337994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.344190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6afda3b1-567d-4131-ab2a-10f75d650846 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1428 microversion: 2.1 time: 0.121588 Sep 13 10:17:37.345072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 151/289] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:37 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:37.478454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.487468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.488956 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.490234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6932cf9b-00da-44fb-8c75-1c06ac74a1c6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.170102 Sep 13 10:17:37.490808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 139/290] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:37 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:37.525742 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:37.526350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:37.532982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.533695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.534461 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.534756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:37.535951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:37.535951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:37.679862 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:37.693915 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5c591d8c-8cdc-4e44-9fe0-78c13eb8b700 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1314 microversion: 2.1 time: 0.171892 Sep 13 10:17:37.694502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 152/291] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:37 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:38.138567 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:38.139291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:38.151992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.151992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.151992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.151992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.152369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.152369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.293618 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.301793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ca8475fc-20cb-4da4-8dd2-7a7f9124541d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.167128 Sep 13 10:17:38.302363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 140/292] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:38 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:38.370538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:38.370538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:38.375649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.376134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.376582 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.377253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.377707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.378120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.413882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.414414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.414849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.415331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lazy-loading 'fault' on Instance uuid a2f3dda9-b22b-462e-8654-72dd969ed185 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:38.459540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.467144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-03e89850-a037-4d00-b776-e2cfa73ff2da tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1304 microversion: 2.1 time: 0.102939 Sep 13 10:17:38.467733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 153/293] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:38 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:38.516764 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:38.517406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:38.523384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.523869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.524304 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.524991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.525446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.525871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.717450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.722168 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:38.722797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:38.731394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.736159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.737968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9d490fb4-f776-497f-8545-a1fd085c4f72 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.224870 Sep 13 10:17:38.739146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 141/294] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:38 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:38.749379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.749877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.750318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.751029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:38.751554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:38.752244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:38.941869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:38.950058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e23abbcb-26f2-434e-a4d8-fd1fb2374f9e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1498 microversion: 2.1 time: 0.237246 Sep 13 10:17:38.950625 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 154/295] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:38 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1498 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:39.333694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:39.334364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:39.341926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.342431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.343108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.343842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.344312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.344814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.486546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:39.490615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:39.494513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:39.503998 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.504696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.510431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-760f05e5-749c-42ff-90c6-0c5945abcb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.174934 Sep 13 10:17:39.510594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.510594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.510594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.510594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.510918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 142/296] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:39 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:39.543751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.544249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.545466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.545944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lazy-loading 'fault' on Instance uuid a2f3dda9-b22b-462e-8654-72dd969ed185 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:39.588093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '981d5bb01b35421ba8afe0df824ba5f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9655193b10a47e6ba071e70d0d8b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:39.596373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a747a4a4-91b6-465f-9900-5aa66466f71e tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 200 len: 1304 microversion: 2.1 time: 0.109965 Sep 13 10:17:39.596938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 155/297] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:39 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:39.767071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:39.767707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:39.774765 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.775184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.775626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.776353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.776824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.777256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.859926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:39.860504 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:39.867045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.867749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.868201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.868911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:39.869365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:39.869945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:39.896810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:17:39.922822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:39.933476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:39.935220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:39.936579 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d6945320-d722-4f24-822d-cc1c62c6e117 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.173980 Sep 13 10:17:39.937128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 143/298] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:39 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:40.211253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7fcc29cf-125d-440e-a5df-c99e479c9679 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 204 len: 0 microversion: 2.1 time: 0.355870 Sep 13 10:17:40.211843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 156/299] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:17:39 2022] DELETE /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:17:40.220036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:40.222220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:40.226591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.227066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.227530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.228218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.228667 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.229091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.361686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:40.370135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f305fce0-2443-4a86-92af-a930b8d7f310 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1504 microversion: 2.1 time: 0.153870 Sep 13 10:17:40.370811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 144/300] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:40 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:40.532881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:40.533589 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:40.539483 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.539958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.540386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.541070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.541517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.541937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.618716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:40.620102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] [instance: a2f3dda9-b22b-462e-8654-72dd969ed185] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:40.626830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.627402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.627848 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.628560 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.629017 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.629639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.644951 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] HTTP exception thrown: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Request method failure captured: Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 HTTP/1.1 Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFilac2K9ofYTmNXmYBmM6WjUT_g2RpqIKMdwSZxoihi-luBPn2nBXRxEKCDEGG0pzL2rtcK4iZjBYoO76pWGhgQzxhtNi4fcUHi9i90xT_PhRVtAmB_4Ah87l7J6JSX-295hjzjLvq_V1eYaDKUQAlg1Ljac7jYxcrCoF3AIetKdnA Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: e9655193b10a47e6ba071e70d0d8b7aa Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesNegativeTest-1608754453 Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:17:40.646627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e9655193b10a47e6ba071e70d0d8b7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e9655193b10a47e6ba071e70d0d8b7aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9655193b10a47e6ba071e70d0d8b7aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e9655193b10a47e6ba071e70d0d8b7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesNegativeTest-1608754453 Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: e9655193b10a47e6ba071e70d0d8b7aa Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesNegativeTest-1608754453 Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesNegativeTest-1608754453-project Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 981d5bb01b35421ba8afe0df824ba5f6 Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesNegativeTest-1608754453-project Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. Sep 13 10:17:40.648272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'a2f3dda9-b22b-462e-8654-72dd969ed185'} Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:17:40.649200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. Sep 13 10:17:40.650734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:17:40.652048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] Returning 404 to user: Instance a2f3dda9-b22b-462e-8654-72dd969ed185 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:17:40.652048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cf96b03f-24b5-4b1a-b293-73ab18ccc972 tempest-VolumesNegativeTest-1608754453 tempest-VolumesNegativeTest-1608754453-project] 10.222.0.62 "GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185" status: 404 len: 111 microversion: 2.1 time: 0.033567 Sep 13 10:17:40.652048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 145/301] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:40 2022] GET /compute/v2.1/servers/a2f3dda9-b22b-462e-8654-72dd969ed185 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 10:17:40.679524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:40.687348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fcc5b5e9-3020-4858-949c-8c6d3780dace tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.158911 Sep 13 10:17:40.688807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 157/302] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:40 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:40.963788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:40.964390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:40.970979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.971506 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.971975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:40.972668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:40.973117 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:40.973545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.129028 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:41.137159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:41.138989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:41.140309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a9d7dfb1-8293-48f5-a8a4-3d671d7bb000 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.180465 Sep 13 10:17:41.140949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 146/303] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:40 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:41.395117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:41.405640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:41.405640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.405640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.405640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.408197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.408197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.408197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.547469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:41.559127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-766a4994-42fc-430f-b058-119d0534f7b8 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1504 microversion: 2.1 time: 0.169116 Sep 13 10:17:41.559721 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 158/304] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:41 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:41.711110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:41.711752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:41.718486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.718968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.719411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.720100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.720540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.720955 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.857742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:41.866203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0e8638e0-7962-4c9f-a629-be9101046a09 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1501 microversion: 2.1 time: 0.158921 Sep 13 10:17:41.866766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 147/305] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:41 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:41.892012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc2d7fd-9841-4b46-9822-c3f9f19a9a75"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:41.896352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:41.900504 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.900984 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.901416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.902103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.902554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.902979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.927902 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] HTTP exception thrown: Cannot 'attach_volume' instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f while it is in vm_state rescued Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Request method failure captured: Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/os-volume_attachments HTTP/1.1 Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 74 Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhZW4sQTdUdZZXUi6MiBHiUiD-r5b4inlnbzQ8KrJFEK8yqPkz6ZcETvOIm2ezY487UrNV_r9UGFyYN8iqoug_PkIaC_cfiMkIoPsdJRxHj6fPNe881V3X1jiwdNBz5-gZigcitM4e-YybhYXBdamEb2Dxx0jQZ--YTjFSMkf-OMhc Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:17:41.930986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 1cc3e06e1b1440c18c0fb902beeed27d Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {"volumeAttachment": {"volumeId": "bfc2d7fd-9841-4b46-9822-c3f9f19a9a75"}} Sep 13 10:17:41.932558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Cannot 'attach_volume' instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f while it is in vm_state rescued Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'server_id': 'cc04ffd6-17d2-4446-9a30-5bf651dd5a3f', 'body': {'volumeAttachment': {'volumeId': 'bfc2d7fd-9841-4b46-9822-c3f9f19a9a75'}}} Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:17:41.933494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f while it is in vm_state rescued Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:41.934866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f while it is in vm_state rescued Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Returning 409 to user: Cannot 'attach_volume' instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f while it is in vm_state rescued {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-55510924-4d88-443d-becb-5f2d8fb71692 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044097 Sep 13 10:17:41.943007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 159/306] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:17:41 2022] POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 10:17:41.944660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:41.945220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:41.947100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:41.951775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.952256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.952983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:41.953677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:41.954208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:41.954576 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.173790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:42.173790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:42.175807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.176474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.177050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.177902 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.178279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.178707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.232276 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-52b112af-d328-4874-8c02-7d8314af673f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/action" status: 202 len: 0 microversion: 2.1 time: 0.293648 Sep 13 10:17:42.236619 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 148/307] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:17:41 2022] POST /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:17:42.243207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:42.244274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:42.250521 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.251022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.251505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.252206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.252666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.253099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.360054 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:42.370689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:42.372657 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:42.373995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-81b81937-4995-4259-aba9-d9da36f78330 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.210367 Sep 13 10:17:42.374715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 160/308] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:42 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:42.420132 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:42.428489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b5406f65-8760-4aad-9375-ad00dcd7adb6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1509 microversion: 2.1 time: 0.190531 Sep 13 10:17:42.429037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 149/309] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:42 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:42.584001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:42.584648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:42.591274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.591883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.592571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.593348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:42.593876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:42.594368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:42.729043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:42.736817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4ec22111-4d26-4234-9ca3-f5f6f74a2ffb tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1504 microversion: 2.1 time: 0.158437 Sep 13 10:17:42.737383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 161/310] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:42 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:43.400147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:43.401095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:43.408025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.408511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.408944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.409636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.410088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.410511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.458255 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:43.458970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:43.465930 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.466687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.467686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.468587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.469240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.470032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.591207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:43.601880 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:43.603810 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:43.615463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b0fcc46b-7f5c-4a11-93a7-914916eee184 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.208725 Sep 13 10:17:43.615463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 150/311] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:43 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:43.760646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:43.761260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:43.767897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.768435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.768884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.769736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:43.770245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:43.770842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:43.794659 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:43.804453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a3e9912b-169c-4c89-8b3c-d37bdbb7f4e2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1509 microversion: 2.1 time: 0.349996 Sep 13 10:17:43.805777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 162/312] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:43 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:44.137582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:44.151082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0ae0c833-31e6-4705-b7be-1373baaaf0a4 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1504 microversion: 2.1 time: 0.394763 Sep 13 10:17:44.151808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 151/313] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:43 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:44.539321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dfac68f-b013-4c67-949c-d1fd909bb3e5", "name": "network-vif-deleted", "tag": "8da7e5cd-29ef-4dce-b867-35c3a5b93ab8"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:44.553732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:44.554121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:44.554550 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:44.570647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] Creating event network-vif-deleted:8da7e5cd-29ef-4dce-b867-35c3a5b93ab8 for instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 on hv-cinder-85427 Sep 13 10:17:44.577378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-0e5dd37b-664b-4a24-ad14-efed14b78633 req-a8ca1ff3-e8a2-43f5-b964-208abd0ef217 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045247 Sep 13 10:17:44.578207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 163/314] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:44.647402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:44.648013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:44.654550 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a2a8d5c-d2de-42a7-bffd-a911fd34c06f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: .version_select at 0x7f46c12bb8b0>, body: {"keypair": {"name": "tempest-keypair-1229799980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK92ku61v6n/jNT3yL8QnafNE8CkZrXSPo/+Z+KTUVBa+Q7xz5src7TQt128dSGOL7iLYaC+UYcgvKk73g4YncPIiNA4SIl/SKTYEs3cEvlrUv3BOQeXlp2BRsqnDLLHbA=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:44.656073 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:44.656567 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:44.657030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:44.657761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:44.658166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:44.658607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:44.672035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-3a2a8d5c-d2de-42a7-bffd-a911fd34c06f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:44.688901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-3a2a8d5c-d2de-42a7-bffd-a911fd34c06f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:44.796783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:44.800912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3a2a8d5c-d2de-42a7-bffd-a911fd34c06f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148732 Sep 13 10:17:44.800912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 164/315] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:17:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:17:44.813023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:44.815121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:44.818715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-78cea99c-bab8-4bf6-b1a2-d2434ae152d4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.173076 Sep 13 10:17:44.818715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 152/316] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:44 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:44.827798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:44.828654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:44.835891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:44.839841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:44.839841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:44.839841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:44.839841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:44.840400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:44.975278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:44.983031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-77cf4dfc-e5a5-48d8-942d-ea8fcd2d1b8c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1509 microversion: 2.1 time: 0.159100 Sep 13 10:17:44.983648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 165/317] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:44 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:45.178575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:45.178575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:45.183613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:45.184106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:45.184539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:45.185239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:45.185691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:45.186422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:45.253119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:45.261228 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5cfe0894-c136-4092-b828-67104eeb3476 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1462 microversion: 2.1 time: 0.091224 Sep 13 10:17:45.262189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 153/318] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:45 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:45.847956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:45.848739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:45.854762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:45.855280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:45.855721 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:45.856411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:45.856871 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:45.857294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:45.860117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:45.992919 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:46.001474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:46.003078 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:46.004364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6f828eae-2290-4dc8-901e-6f07e58c9fc2 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.161162 Sep 13 10:17:46.004909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 166/319] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:45 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:46.007711 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:46.014688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:46.014800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:46.015317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:46.015767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:46.017102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:46.017564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:46.017996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:46.165144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:46.168678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:46.178911 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d5c51940-ad1f-49f3-8215-8da89e903b90 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1509 microversion: 2.1 time: 0.170811 Sep 13 10:17:46.178911 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 154/320] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:46 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:46.285761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:46.286396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:46.294094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:46.294826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:46.295457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:46.296162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:46.296611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:46.297269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:46.379758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:46.388046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-34638581-39d9-48a4-8bcc-618ca1bb8076 tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1299 microversion: 2.1 time: 0.107090 Sep 13 10:17:46.388688 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 167/321] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:46 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:47.030761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:47.036571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:47.041439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.042196 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.042947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.043890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.044532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.045443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.198432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:47.198974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:47.205975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.206472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.206909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.207664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.208122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.208548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.707707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:47.712826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:47.717564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:47.719258 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:47.720776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-aedcd7c0-2096-486c-9829-0cc228dc8a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.694556 Sep 13 10:17:47.721059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2f77bb11-6593-4e39-9d7a-2f7794c8c576 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1509 microversion: 2.1 time: 0.526369 Sep 13 10:17:47.721332 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 155/322] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:47 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:47.721625 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 168/323] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:47 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:47.741515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:47.746929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:47.748783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.749395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.749918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.751498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.752428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.752639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.786282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:47.786854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:47.787582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:47.788271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lazy-loading 'fault' on Instance uuid 1dfac68f-b013-4c67-949c-d1fd909bb3e5 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:17:47.854336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c886285823a45a0b921a180d5bf4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723137b6e4764ec6b58b46f84a05a37e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:47.863378 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-801bbb10-001a-42d0-a4bf-13d5e7ed3a8f tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 200 len: 1304 microversion: 2.1 time: 0.126808 Sep 13 10:17:47.863953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 156/324] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:47 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:48.044662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1124227279", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a50e7ab-833a-427c-9bea-0d826ae0fb4a"}], "security_groups": [{"name": "tempest-securitygroup--1708932693"}], "key_name": "tempest-keypair-1229799980", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:48.232596 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] validate_networks() for [('3a50e7ab-833a-427c-9bea-0d826ae0fb4a', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:17:48.748464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:48.749148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:48.756611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.757102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.757539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:48.758246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.758889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.759512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:48.801469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:17:48.801947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:17:48.802424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:17:48.802853 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:17:48.803412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:17:48.816049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.817204 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.818286 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:48.820869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.821526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.822624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:48.851809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:48.858879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:48.870905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:17:48.873294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:17:48.894012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:17:48.913764 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:48.923481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:48.925024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:48.926268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-254fa30e-aec7-4cc9-935d-99a718e2fd4c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.183105 Sep 13 10:17:48.926821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 157/325] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:48 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:48.931551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:48.932145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:48.939207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.939624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.940334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:48.941185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:48.941781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:48.942350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:49.032491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3178aebc-c1c7-416f-9ef1-82e2bd7bd312 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.992170 Sep 13 10:17:49.033903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 169/326] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:17:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:17:49.038932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:49.043583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] [instance: 1dfac68f-b013-4c67-949c-d1fd909bb3e5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:49.046794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:49.048467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:49.048467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:49.048699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:49.048951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:49.049577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:49.065715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] HTTP exception thrown: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Request method failure captured: Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 HTTP/1.1 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFiFqwGiMoCE4EuU-JDFNL7I6iqFij2y7rWZkY1pf3HwqMXVZqBcX3cPNCHZWnMnAscPq4QuxakQe-oEwWaOJ5Jn0N_zYPbky9to5CKjNemtBBRf4gwNhhe-cx8ooTcc2x_eQAvlXIyHQmz8_3SDFFwbtIGL2-piv-Q5bVjjtlus8O0 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 723137b6e4764ec6b58b46f84a05a37e Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:17:49.072049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/723137b6e4764ec6b58b46f84a05a37e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 723137b6e4764ec6b58b46f84a05a37e Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesActionsTest-1501221289 Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesActionsTest-1501221289-project Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 6c886285823a45a0b921a180d5bf4f1e Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesActionsTest-1501221289-project Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. Sep 13 10:17:49.074493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '1dfac68f-b013-4c67-949c-d1fd909bb3e5'} Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:17:49.075515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. Sep 13 10:17:49.076939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:17:49.079575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] Returning 404 to user: Instance 1dfac68f-b013-4c67-949c-d1fd909bb3e5 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:17:49.079575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e704b0f8-cf0c-4061-b385-300faf74c87e tempest-VolumesActionsTest-1501221289 tempest-VolumesActionsTest-1501221289-project] 10.222.0.62 "GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5" status: 404 len: 111 microversion: 2.1 time: 0.035708 Sep 13 10:17:49.079575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 170/327] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:49 2022] GET /compute/v2.1/servers/1dfac68f-b013-4c67-949c-d1fd909bb3e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:17:49.086240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0a309039-5023-4bbf-8739-85aff7bb7abb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:49.087085 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0a309039-5023-4bbf-8739-85aff7bb7abb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:49.194322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0a309039-5023-4bbf-8739-85aff7bb7abb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:49.211538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0a309039-5023-4bbf-8739-85aff7bb7abb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1242 microversion: 2.1 time: 0.130547 Sep 13 10:17:49.212126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 171/328] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:49 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:49.310733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:49.322734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5031c5ef-25cd-4436-a93e-e49bb9ea7843 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1515 microversion: 2.1 time: 0.393390 Sep 13 10:17:49.324676 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 158/329] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:48 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:49.960588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:49.961041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:49.968016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:49.968506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:49.968932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:49.969894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:49.970342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:49.970757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:50.142616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:50.152040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:50.153664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:50.155175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9d77c6ef-2cc4-4159-96ea-6eafcbd6eb6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.201182 Sep 13 10:17:50.156010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 172/330] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:49 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:50.239623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:50.240233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:50.252362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:50.253014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:50.253473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:50.254191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:50.254644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:50.255075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:50.333498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:50.343139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-17e38de4-ed9e-4b66-a41d-28e9566a9886 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1246 microversion: 2.1 time: 0.107906 Sep 13 10:17:50.343929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 159/331] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:50 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:51.181861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:51.182473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:51.189337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:51.189820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:51.190249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:51.190939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:51.191451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:51.191851 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:51.329756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:51.338396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:51.339872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:51.341091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1cd28a19-2fe9-4ae7-aa0a-62de79c499de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.163583 Sep 13 10:17:51.341674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 173/332] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:51 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:51.366122 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:51.366736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:51.373683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:51.374172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:51.374929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:51.376261 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:51.376726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:51.377156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:51.455030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:51.462714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87c99974-d38f-4833-848c-1d4a73f81643 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1246 microversion: 2.1 time: 0.100639 Sep 13 10:17:51.463224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 160/333] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:51 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:52.367964 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:52.369485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:52.376523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:52.377090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:52.377618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:52.378446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:52.379000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:52.379809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:52.485592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:52.486196 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:52.493586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:52.494298 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:52.494736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:52.495461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:52.496077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:52.496503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:52.598193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:52.617253 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e7b9ee80-f19b-4835-aa9d-dd0232cfd9e8 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1246 microversion: 2.1 time: 0.134558 Sep 13 10:17:52.631254 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 161/334] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:52 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:52.675641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:52.694221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:52.694221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:52.695668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cf1673d8-aff1-4d73-a9e6-dee874ca683f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.331760 Sep 13 10:17:52.705888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 174/335] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:52 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:53.642123 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:53.642735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:53.649575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:53.650071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:53.650699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:53.651445 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:53.651923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:53.652342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:53.722788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:53.723586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:53.731826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:53.733650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-83c1cfd1-8d42-44db-9370-29bb5ed5c569 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1294 microversion: 2.1 time: 0.096126 Sep 13 10:17:53.736006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:53.737109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:53.737584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:53.738344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:53.738828 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:53.739269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:53.750157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 162/336] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:53 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:53.905350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:53.914350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:53.915870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:53.917075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-60fc0efb-cb9f-4625-a5fa-3ffdf92fcbdc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1745 microversion: 2.20 time: 0.199079 Sep 13 10:17:53.917630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 175/337] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:53 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:17:54.335113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-35d5ea9c-7153-453f-a90d-d87d47295ae1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: .version_select at 0x7f46c11363a0>, body: {"keypair": {"name": "tempest-keypair-1756818781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1DQejRp6aEs4Tt8QVzHZO54rEwgUfEZGOBaB5/NsQXWJH4YmYQy8/KuH5x4C93lCnP5qAVDzA0jhe32SIS7+ZvRsuLk+8p28nHQxzKe7zEGdf3FGDxhpUoFt7aNPdi+g=="}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:54.352070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-35d5ea9c-7153-453f-a90d-d87d47295ae1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:54.356264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-35d5ea9c-7153-453f-a90d-d87d47295ae1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for user 1cc3e06e1b1440c18c0fb902beeed27d and project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:54.447008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-35d5ea9c-7153-453f-a90d-d87d47295ae1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115423 Sep 13 10:17:54.450114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 163/338] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:17:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:17:54.769674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:54.771450 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:54.799260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:54.799804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:54.802750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:54.803566 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:54.804203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:54.804747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:54.895804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:54.908600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c0d64312-db41-4ccc-a22a-06bfeb2159fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1302 microversion: 2.1 time: 0.149836 Sep 13 10:17:54.920977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 176/339] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:54 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:54.952610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:54.955111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:54.973323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:54.974277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:54.983589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:54.983589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:54.983589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:54.983589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:55.181991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:55.192887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:55.195612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:55.197636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1ffb8466-9172-4e29-bff0-bdc80a85bf6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1745 microversion: 2.20 time: 0.258090 Sep 13 10:17:55.200726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 164/340] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:54 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:55.941063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:55.941665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:55.947775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:55.948247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:55.948671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:55.949349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:55.949816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:55.950231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:56.055698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:56.077713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-993155d5-5588-4df1-9a4e-c4ddbc2a0415 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1302 microversion: 2.1 time: 0.140965 Sep 13 10:17:56.086063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 177/341] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:55 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1302 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:56.224575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:56.226309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:56.234086 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:56.235103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:56.236097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:56.237048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:56.237508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:56.238102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:56.641069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:56.650924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:56.652459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:56.653671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0c1f144c-7c27-4929-ae29-3b655e00c949 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1745 microversion: 2.20 time: 0.433303 Sep 13 10:17:56.654486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 165/342] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:56 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1745 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:57.104310 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:57.104999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:57.114126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:57.119237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:57.119835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:57.120612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:57.121145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:57.121517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:57.201547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:57.210222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-58ca0268-1503-4fea-a7aa-f267b374f745 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1302 microversion: 2.1 time: 0.111017 Sep 13 10:17:57.210774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 178/343] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:57 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:57.682039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:57.685664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:57.697317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:57.698898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:57.698898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:57.698898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:57.703797 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:57.704482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:57.779330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-296727184", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ecb5458-53ff-4af9-903b-3aeac85684dc"}], "security_groups": [{"name": "tempest-securitygroup--1587637906"}], "key_name": "tempest-keypair-1756818781", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:17:57.940738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:57.952109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:57.956550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:57.961376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-65804e80-6049-4faa-8e64-1ec0f9fac520 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1745 microversion: 2.20 time: 0.283063 Sep 13 10:17:57.962178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 166/344] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:57 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:17:57.978039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] validate_networks() for [('8ecb5458-53ff-4af9-903b-3aeac85684dc', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:17:58.232854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:58.233465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:58.240170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:58.240849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:58.241566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:58.242603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:58.243355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:58.243965 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:58.448507 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:58.461780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-37b11a66-6f50-46c3-9195-5947c89c2da2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1302 microversion: 2.1 time: 0.232721 Sep 13 10:17:58.480717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 167/345] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:58 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1302 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:17:58.774541 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:17:58.775027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:17:58.775478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:17:58.775884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:17:58.776296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:17:58.823084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:58.825826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:58.826307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:58.827120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:58.827614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:58.828041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:58.890401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:17:58.895539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Getting quotas for user 1cc3e06e1b1440c18c0fb902beeed27d and project 602cd87d731241e3ad12032e2dd67c1b. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:17:58.919369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:17:58.923361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:17:58.990433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:58.991104 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:59.008775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:59.009290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:59.009741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:59.013150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:59.013691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:59.016991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:59.211863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:59.219850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:59.221308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:59.228609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bee91d3e-0191-45b3-a366-95b8d520db0f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.243922 Sep 13 10:17:59.229217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 168/346] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:17:58 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:17:59.265462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7079847f-e3fb-4417-9f88-8fb025fb3064 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.495248 Sep 13 10:17:59.269351 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 179/347] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:17:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:17:59.282758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-69768e7e-945a-4d4c-ae98-25830a670465 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:59.283590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-69768e7e-945a-4d4c-ae98-25830a670465 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:59.436371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-69768e7e-945a-4d4c-ae98-25830a670465 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:59.436371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-69768e7e-945a-4d4c-ae98-25830a670465 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1245 microversion: 2.1 time: 0.158685 Sep 13 10:17:59.448996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 169/348] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:59 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:17:59.489728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:17:59.490334 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:17:59.496425 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:59.496916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:59.497355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:59.511082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:17:59.511602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:17:59.512826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:17:59.713591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:17:59.729847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e49bd55b-139f-4d62-8848-0056b6b72ccf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1300 microversion: 2.1 time: 0.244513 Sep 13 10:17:59.746318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 180/349] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:17:59 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:00.264255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:00.264864 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:00.277121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:00.278262 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:00.281177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:00.281177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:00.281177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:00.282896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:00.471404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e35df15f-3246-477b-be4c-e84d473e827b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:00.560470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e35df15f-3246-477b-be4c-e84d473e827b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:00.560470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e35df15f-3246-477b-be4c-e84d473e827b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:00.561892 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:00.568480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:00.570219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:00.570570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e35df15f-3246-477b-be4c-e84d473e827b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1245 microversion: 2.1 time: 0.107433 Sep 13 10:18:00.571573 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a82e34f6-62b4-4025-ba24-4458f3acbeea tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.311242 Sep 13 10:18:00.579566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 170/350] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:00 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:00.585259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 181/351] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:00 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:00.773082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:00.777800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:00.796345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:00.798134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:00.799542 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:00.800435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:00.803606 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:00.806780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:01.289361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:01.304716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-707a9cb3-a8ba-4a75-aa1f-bc153c70dfc2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.536381 Sep 13 10:18:01.305311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 171/352] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:00 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:01.598274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:01.598931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:01.600199 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:01.601283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:01.623657 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:01.624974 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:01.625594 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:01.626517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:01.631803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:01.635058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:01.648691 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:01.651928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:01.660330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:01.666745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:01.679621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:01.685167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:01.938516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:01.950899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-71fc19c8-f278-4755-badd-700bc81a722f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1249 microversion: 2.1 time: 0.355093 Sep 13 10:18:01.954627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 182/353] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:01 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1249 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:02.332454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:02.335261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:02.357106 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:02.358907 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:02.360966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:02.363914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:02.363914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:02.363914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:02.418405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:02.434885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:02.436394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:02.445204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c45fc49e-c911-40f7-aba5-081b8fb92906 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.848366 Sep 13 10:18:02.447569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 172/354] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:01 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:02.649812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "name": "network-vif-plugged", "status": "completed", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:02.686459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:02.688889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:02.696491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:02.705157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:02.738027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] Creating event network-vif-plugged:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:18:02.775743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-943cdfd5-9132-4024-b2a4-6f5fb921f822 req-7b5092fe-0d20-4766-8d49-5372b280e3da service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141745 Sep 13 10:18:02.776369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 173/355] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:18:02.983841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:02.995144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:03.018335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:03.020559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:03.024245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:03.032519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:03.041508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:03.043363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:03.321928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:03.340854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fd5380dc-2f86-4278-8400-bea0f7a51095 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1297 microversion: 2.1 time: 0.362482 Sep 13 10:18:03.346869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 174/356] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:02 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1297 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:03.478115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:03.479655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:03.489621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:03.492443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:03.493101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:03.494006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:03.495021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:03.497260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:03.971753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:03.982395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2efae48d-23a3-4bfd-bbd4-3d8e054e84f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 1.655901 Sep 13 10:18:03.983502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 183/357] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:02 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:04.371547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:04.372425 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:04.412109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:04.427749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:04.428403 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:04.429755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:04.446798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:04.448892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:04.480443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:04.493431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:04.494988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:04.496247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e32a52cb-bdfe-47a1-a91e-aee5ee21d9e0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 1.022653 Sep 13 10:18:04.513342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 175/358] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:03 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:04.860613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd48156b-79bf-41ef-8a3d-3b5265dae93c", "tag": "3f20d233-f49a-4ba0-bc07-8628d35a3d2c"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:04.870230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:04.879214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:04.879570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-16579d9a-3450-4f81-b545-0db6aa6787d4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1315 microversion: 2.1 time: 0.513209 Sep 13 10:18:04.880158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:04.886549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:04.900210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 184/359] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:04 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:04.908186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] Creating event network-changed:3f20d233-f49a-4ba0-bc07-8628d35a3d2c for instance cd48156b-79bf-41ef-8a3d-3b5265dae93c on hv-cinder-85427 Sep 13 10:18:04.917558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-39be0229-c74b-499d-84f5-b4ebe89d6270 req-10517b77-f82b-4029-99b4-c6b389004e2d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066813 Sep 13 10:18:04.922236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 176/360] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:05.019195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:05.019195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:05.044359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:05.045456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:05.047778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:05.048710 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:05.049705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:05.050443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:05.540721 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:05.541421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:05.570549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:05.571595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:05.578642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:05.581055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:05.585944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:05.594363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:06.505416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:06.523424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c55b88bc-7b37-496c-8c26-77cb9ce88a33 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 1.515559 Sep 13 10:18:06.524508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 185/361] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:05 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:06.535025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:06.538894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:06.553131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:06.555802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:06.556920 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:06.559729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:06.560454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:06.562350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:06.783955 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:06.787695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:06.801254 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-595271ad-6811-4dcc-b340-c517385b49ea tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1303 microversion: 2.1 time: 0.274729 Sep 13 10:18:06.817937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 186/362] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:06 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1303 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:06.928980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:06.944275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:06.948351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:06.950095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-931281cc-1fd2-4b03-8ab6-7266c8db2083 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 1.414515 Sep 13 10:18:06.952369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 177/363] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:05 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:07.246560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cf6de9c7-939a-4a84-9418-6ea135f98cd5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Action: 'create', calling method: .version_select at 0x7f46c117f1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-869991838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ2KA5ECn6J5nc87xbGL20doKq8MrBld4XbRdjOYHt6pWGMImt9jCKa48P2uJjPfP5FWnvNzaczyFltNFp6KuddJ9woQFRuoS/YKea8XKPHU/cNVba3LMHEYS+umQoSsQ=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:07.267799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=21 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:07.269201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-cf6de9c7-939a-4a84-9418-6ea135f98cd5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for project 7cc199dd87e24511a8d267603b571456. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:18:07.273872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-cf6de9c7-939a-4a84-9418-6ea135f98cd5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for user 7ddb2572cac446aa92a0bcf170d9e8d6 and project 7cc199dd87e24511a8d267603b571456. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:18:07.365354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cf6de9c7-939a-4a84-9418-6ea135f98cd5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.557704 Sep 13 10:18:07.367091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 187/364] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:18:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:07.557583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:07.558073 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:07.575789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:07.577567 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:07.578731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:07.582032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:07.584767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:07.585477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:07.830628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:07.832100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:07.846401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:07.848411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:07.850639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:07.853003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:07.854634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:07.866885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:08.402618 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:08.414682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6df2abad-d078-468e-b85d-08e62ac5a99b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.862309 Sep 13 10:18:08.415657 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 178/365] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:07 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:08.426265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:08.429498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:08.438518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:08.439867 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:08.440547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:08.441490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:08.442267 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:08.442905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:08.861857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:08.963354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:08.975634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-936168bb-a21a-44bc-ad3d-468a5915d9ad tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 1.148816 Sep 13 10:18:08.980465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 188/366] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:07 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:09.356313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:09.379311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:09.380807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:09.382030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b9011732-24d5-49ca-aa2b-ca3aa5455abf tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.964602 Sep 13 10:18:09.390750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 179/367] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:08 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:09.450271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:09.450903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:09.480517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:09.490436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:09.490909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:09.491686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:09.492149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:09.501282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:10.003753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:10.004979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:10.020143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=6 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:10.025632 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:10.027713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:10.028392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:10.031013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:10.031774 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:10.033170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:10.478047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:10.487253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2a94cffb-97f5-4963-8802-5fa4cc4f03bf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 1.045081 Sep 13 10:18:10.487775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 189/368] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:09 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:10.538505 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:10.539128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:10.570883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:10.571408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:10.572204 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:10.573241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:10.573704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:10.574138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:11.096079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:11.104161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-42cc9114-3d01-411a-be9a-f482dd547e9e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 1.105950 Sep 13 10:18:11.126139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 180/369] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:09 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:11.221066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:11.242384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:11.255039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:11.261119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ada2dc31-7ec6-4bd7-bc7b-ccf9d4360f88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.741350 Sep 13 10:18:11.263785 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 190/370] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:10 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:11.510082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:11.511497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:11.514306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:11.526346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:11.529397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:11.549076 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:11.550813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:11.553373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:11.557561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:11.564663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:11.565403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:11.567516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:11.612559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] Creating event network-changed:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:18:11.623242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-4e9d3b73-976c-4c91-8653-438d80d2ee5e req-2f7d10d5-f4e8-45c7-9500-011597b480cc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123133 Sep 13 10:18:11.626404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 181/371] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:12.135890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:12.136668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:12.139362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:12.200569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:12.204204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:12.252259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:12.254942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:12.324214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:12.324214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:12.456904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:12.456904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-71708495-2d44-47bb-8e4d-4747b35081e0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.933686 Sep 13 10:18:12.456904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 191/372] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:11 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:12.456904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:12.457244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:12.468810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:12.469694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:12.470366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:12.471422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:12.472244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:12.472922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:12.769634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:12.785967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:12.796146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:12.801601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:12.804390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-41bfaee8-9f79-498d-93d6-0f01448ed140 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.362728 Sep 13 10:18:12.812479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 192/373] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:12 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:12.821656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c3319af7-8ef9-4d88-882a-bd82c20bcf31 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.692227 Sep 13 10:18:12.830530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 182/374] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:12 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:13.474502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:13.475517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:13.487820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.491409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.493376 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:13.494352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.495843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.498974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:13.760820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:13.769877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d3ceae2a-6d2e-4a87-9383-50db976bae92 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.299701 Sep 13 10:18:13.802644 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 193/375] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:13 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:13.835727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:13.837064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:13.846868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.847757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.848469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:13.849413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.850114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.850227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:13.850800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:13.851061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:13.864686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.865222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.865667 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:13.866384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:13.866833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:13.867290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:14.120234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:14.132494 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:14.137601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:14.142939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2fccec02-75e4-452c-bd58-374a88040074 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.312089 Sep 13 10:18:14.144335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 183/376] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:13 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:14.148126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:14.156701 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4852bd94-994c-4f32-b172-c99b7ea22ef6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.311114 Sep 13 10:18:14.158266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 194/377] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:13 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:14.807582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:14.810135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:14.818512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:14.825835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:14.826427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:14.827409 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:14.828855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:14.829359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:15.031765 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:15.042037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-620f901b-a5fb-401b-a72d-f3066c802ef1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.238329 Sep 13 10:18:15.044148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 184/378] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:14 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:15.171353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:15.173169 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:15.182519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:15.183586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:15.195146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:15.197464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:15.198136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:15.199666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:15.200101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:15.200811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:15.201490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:15.202148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:15.204057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:15.204503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:15.205181 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:15.208366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:15.447993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:15.461136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:15.464514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:15.466301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:15.467798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-72f8d1bb-7c71-4452-bfd4-ac8f4482abf3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.301347 Sep 13 10:18:15.474508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ab11b840-9d0a-43dc-81cb-995538254a8a tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.295807 Sep 13 10:18:15.474508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 185/379] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:15 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:15.475137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 195/380] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:15 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:16.066014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:16.066757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:16.073705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.074202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.074640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.075395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.075856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.076318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.226475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:16.235139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3fbf0796-1c92-40c9-abc9-b658e170b787 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.173287 Sep 13 10:18:16.235727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 186/381] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:16 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:16.501159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:16.503484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:16.504895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:16.509519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:16.518385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.520443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.520958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.521508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.522205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.522733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.523155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.525201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.525682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.526463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:16.526982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:16.527444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:16.763819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:16.775289 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:16.779883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:16.780561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:16.781693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ff5be94c-9ec8-46cb-95ea-0050778e0f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.290565 Sep 13 10:18:16.793446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fbec94ba-e0e0-4bf3-8723-551c6d9f7d49 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.300465 Sep 13 10:18:16.807190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 196/382] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:16 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:16.807814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 187/383] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:16 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:17.258127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:17.258689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:17.281741 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.286024 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.287803 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.301369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.305084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.306948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.575230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:17.588111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b715acf4-83ce-4fee-98ff-d001549d4f74 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.333934 Sep 13 10:18:17.589768 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 197/384] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:17 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:17.809306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:17.810552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:17.817978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.820761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.820761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.820761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.820761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.821578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.822632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:17.823287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:17.866983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.867539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.867978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.868909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:17.869523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:17.870281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:17.870870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:18.098107 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:18.114512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:18.117911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:18.125458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:18.127131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c4e644ca-3dd0-416a-928b-250b6c9bdad1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.321966 Sep 13 10:18:18.135203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 188/385] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:17 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:18.142539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-53e02edc-786a-49d1-89a1-70f5cee93bed tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.319667 Sep 13 10:18:18.144400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 198/386] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:17 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:18.614720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:18.615383 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:18.631779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:18.634411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:18.634876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:18.640931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:18.642185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:18.642821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:18.869040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:18.879770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f41c334c-e127-4db4-9533-f32ba30a9a11 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.267398 Sep 13 10:18:18.879770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 189/387] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:18 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:18.962610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd48156b-79bf-41ef-8a3d-3b5265dae93c", "name": "network-vif-plugged", "status": "completed", "tag": "3f20d233-f49a-4ba0-bc07-8628d35a3d2c"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:18.981316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:18.982264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:18.982943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:18.995069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] Creating event network-vif-plugged:3f20d233-f49a-4ba0-bc07-8628d35a3d2c for instance cd48156b-79bf-41ef-8a3d-3b5265dae93c on hv-cinder-85427 Sep 13 10:18:19.001368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-51af4289-3370-48cf-8a4b-45a93e2a9350 req-686561e6-95c5-403e-9de6-f964f42ba98a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042775 Sep 13 10:18:19.002322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 199/388] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:18:19.170209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:19.171576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:19.173374 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:19.175189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:19.183156 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.184002 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.184740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:19.184893 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.185254 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.185704 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:19.186415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.187155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.191087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.191582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:19.203914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.204725 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:19.473790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:19.473790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:19.474500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:19.474500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-139ff004-1ae5-4c68-88ae-5d8cf28ac616 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.288251 Sep 13 10:18:19.474500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 190/389] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:19 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:19.474732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:19.491516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c8bf4e52-332d-41f9-94b6-604f5e9d092f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.325135 Sep 13 10:18:19.492422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 200/390] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:19 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:19.904115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:19.906303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:19.914428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.915546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.916138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:19.917259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:19.917973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:19.918722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:20.150638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:20.154569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:20.173486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fa432a5c-6564-4d73-a0a2-e14e299182f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.261647 Sep 13 10:18:20.173486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 191/391] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:19 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:20.492564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:20.493875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:20.502194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:20.503659 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:20.504787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:20.506729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:20.508202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:20.508929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:20.518743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:20.520092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:20.535720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:20.545686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:20.545686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:20.545686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:20.549106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:20.549870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:20.776753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:20.809294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:20.824008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:20.828474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6f59b4a6-6d37-432a-a3f3-ad469a42322c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1740 microversion: 2.20 time: 0.340166 Sep 13 10:18:20.829048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 201/392] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:20 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:21.189448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:21.190351 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:21.203000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:21.208109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:21.211326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:21.217028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:21.217028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:21.221188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:21.221671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:21.223151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:21.253002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3b0f6964-4807-47fc-b77e-4742b3feeaf5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.737308 Sep 13 10:18:21.255886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 192/393] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:20 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:21.536304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:21.548329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d45749d2-547b-45aa-b62e-1de621075bd7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.363193 Sep 13 10:18:21.553808 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 202/394] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:21 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:21.859499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:21.860284 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:21.867212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:21.867879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:21.868574 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:21.869792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:21.870394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:21.870969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:22.117775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:22.128312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:22.130955 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:22.133158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-171e7f99-9676-4f16-a485-b96ed4241e9c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1722 microversion: 2.20 time: 0.277616 Sep 13 10:18:22.133984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 193/395] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:21 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:22.277849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:22.278996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:22.287066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:22.287868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:22.288312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:22.289010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:22.289465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:22.289892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:22.428165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:22.439058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3ded4507-751b-4013-8267-3c5d261d04d8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.162131 Sep 13 10:18:22.446058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 203/396] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:22 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:22.572370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:22.572999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:22.580062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:22.581106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:22.581382 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:22.582265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:22.582746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:22.583314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:22.879183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:22.888222 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-db30a896-e596-4298-9278-be4a6b8bc078 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.319773 Sep 13 10:18:22.888798 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 194/397] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:22 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:23.163496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:23.164693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:23.177360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.178383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.183761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.185055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.186087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.186568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.389018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:23.401307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:23.403213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:23.408074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fe44721b-bc6d-4732-a692-475e68432701 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1722 microversion: 2.20 time: 0.245783 Sep 13 10:18:23.408074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 204/398] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:23 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:23.463584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:23.465408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:23.477490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.482756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.482756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.482756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.482756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.483204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.712944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:23.722800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-552ef778-afc6-4709-a4f7-06eef0afbf93 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.266556 Sep 13 10:18:23.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 195/399] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:23 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:23.913882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:23.914861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:23.922324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.931496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.934976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.935789 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:23.936272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:23.944672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:23.954271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:24.285829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:24.296635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0cdc37aa-9780-4615-9ce0-124fb45a4cc4 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.386172 Sep 13 10:18:24.297760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 205/400] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:23 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:24.437481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:24.438267 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:24.445465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:24.445968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:24.446414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:24.447138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:24.456100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:24.461154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:24.741684 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:24.752217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:24.753663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:24.761202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:24.761202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:24.761202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0b6b879e-9297-4c23-9e15-bddcf2993672 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1722 microversion: 2.20 time: 0.327609 Sep 13 10:18:24.762139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 196/401] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:24 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:24.778410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:24.783213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:24.784114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:24.784885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:24.785381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:24.785812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.044927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:25.080170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-88b329a1-2aac-45be-bcc8-edc6ec2ca761 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.305708 Sep 13 10:18:25.080170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 206/402] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:24 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:25.210020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "name": "network-vif-plugged", "status": "completed", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:25.226801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:25.228020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:25.229350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.268756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] Creating event network-vif-plugged:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:18:25.288264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-9cd2252e-5255-472a-b230-cfc5bedfd21a req-5233bc3a-4e2c-49be-a7cf-f700938db381 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083031 Sep 13 10:18:25.289913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 197/403] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:25.326280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:25.331809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:25.345777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:25.346516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:25.346992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.347893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:25.348493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:25.349059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.798334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:25.801475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:25.829865 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:25.830869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:25.832076 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.837317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:25.838127 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:25.839553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:25.963432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:25.980579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a7d65992-82aa-49a3-a710-5ab23df1d7e5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1368 microversion: 2.1 time: 0.663224 Sep 13 10:18:25.995022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 207/404] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:25 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1368 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:26.094594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:26.103265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:26.103265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:26.103520 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:26.103742 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:26.104438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:26.105098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:26.110363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:26.291348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:26.314192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:26.318493 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:26.335603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d6b0069f-7a6d-4fa0-b7e4-9986b87a22f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1722 microversion: 2.20 time: 0.532660 Sep 13 10:18:26.337486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 198/405] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:25 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1722 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:26.509093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:26.523691 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-faf48c6c-330a-4e30-8ea3-f7ff380100b3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.432994 Sep 13 10:18:26.524274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 208/406] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:26 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:27.012626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:27.013393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:27.031056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.031834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.032785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.033735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.034468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.035299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.287876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:27.301843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-11aa78e6-d49d-432c-b082-5adbc499c302 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1557 microversion: 2.1 time: 0.294976 Sep 13 10:18:27.302465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 199/407] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:27 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1557 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:27.334357 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:27.335216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:27.341948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.347120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.347809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.354016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:27.354845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:27.355356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.360946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.360946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.370119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.370800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.371937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.374441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.375553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.376157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.617414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-409e31d7-7053-470a-b953-408f5d2b89fd tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287778 Sep 13 10:18:27.618008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 209/408] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:18:27 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/os-interface => generated 284 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:27.640235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "name": "network-vif-unplugged", "status": "completed", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:27.666112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.666610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.667091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.703569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] Creating event network-vif-unplugged:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:18:27.719792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-d4e7222c-d743-4a2c-97bf-38c7522e1d42 req-ee4b0d9d-abea-48db-8b50-907fe77c3272 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083105 Sep 13 10:18:27.732855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 210/409] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:27.745250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:27.746000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:27.760560 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:27.772762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.773267 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.773704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.774435 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.774896 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.775301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:27.775446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.781666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:27.784663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-75fc1a66-fad9-4bd1-8f35-78d0da27251f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1725 microversion: 2.20 time: 0.433540 Sep 13 10:18:27.785479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 200/410] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:27 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:27.815178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b339f8ab-ce3b-4f10-81ed-9607da5b9ab4"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:27.818042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:27.829298 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.832069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.837907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:27.837907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:27.837907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:27.837907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:28.583178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:28.615477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9f8effc8-b5b1-4a57-b882-40b3e0f03881 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1371 microversion: 2.1 time: 0.870030 Sep 13 10:18:28.616879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 211/411] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:27 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1371 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:29.189752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ca28baaf-63e6-404e-85e5-6f2939299df1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.379127 Sep 13 10:18:29.195993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd48156b-79bf-41ef-8a3d-3b5265dae93c", "tag": "3f20d233-f49a-4ba0-bc07-8628d35a3d2c"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:29.200125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 201/412] 10.222.0.62 () {62 vars in 1364 bytes} [Tue Sep 13 10:18:27 2022] POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments => generated 188 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:18:29.213813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:29.214298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:29.214725 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:29.238856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] Creating event network-changed:3f20d233-f49a-4ba0-bc07-8628d35a3d2c for instance cd48156b-79bf-41ef-8a3d-3b5265dae93c on hv-cinder-85427 Sep 13 10:18:29.253725 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-6830337b-cc6a-48d9-a2cb-0ad45d5e3d81 req-c0ab4501-2fcb-46e4-8001-2b240e5e3fcc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061964 Sep 13 10:18:29.256034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 212/413] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:29.427728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:29.428604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:29.436250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:29.442334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:29.442334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:29.442334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:29.442334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:29.443029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:29.567770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121003) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 10:18:29.628990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:29.631089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:29.639423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:29.648015 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:29.650899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:29.668154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:29.671752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:29.682919 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:30.060799 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fed7b714-dd0a-49dd-b627-c99c8713b9ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/action" status: 202 len: 0 microversion: 2.20 time: 0.633488 Sep 13 10:18:30.064310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 202/414] 10.222.0.62 () {62 vars in 1319 bytes} [Tue Sep 13 10:18:29 2022] POST /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:18:30.093703 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:30.094327 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:30.120343 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:30.123250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:30.123250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:30.123250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:30.123250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:30.123984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:30.343213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:30.354414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3f006df4-aedd-41a8-a7e3-8206abf3fe5f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1565 microversion: 2.1 time: 0.730481 Sep 13 10:18:30.377153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 213/415] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:29 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1565 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:30.384981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:30.385811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:30.404801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:30.411975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:30.412708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:30.414370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:30.415008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:30.415635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:30.606459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:30.621796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:30.626504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:30.630803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-03d9d5dc-2db9-47c3-ae25-b683c98fdce6 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1751 microversion: 2.20 time: 0.551395 Sep 13 10:18:30.631940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 203/416] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:30 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1751 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:30.668227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f1d7e002-2277-46f0-8073-649e4464fb97 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289489 Sep 13 10:18:30.668824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 214/417] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:18:30 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:31.658737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:31.659383 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:31.666879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:31.667758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:31.668440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:31.671639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:31.675220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:31.675928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:31.975032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:31.986964 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:31.988768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:31.990324 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c393f8a4-5766-47e0-a1fd-582c1344b8dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1751 microversion: 2.20 time: 0.336189 Sep 13 10:18:31.991526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 204/418] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:31 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:32.619085 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:32.637256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:32.640305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:32.640305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:32.658162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] Creating event network-changed:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:18:32.664295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-fc9e974b-2e25-4774-aeb2-d4c358f1725c req-f39cfee6-cc44-4809-b834-bc395d2fda00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050188 Sep 13 10:18:32.665770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 215/419] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:33.016715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:33.017326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:33.030522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:33.032397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:33.033050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:33.034592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:33.035299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:33.036180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:33.079698 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:33.633145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:33.645563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:33.650826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:33.654968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-43c13f9b-49cb-44c6-9e16-4f02925b85b1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1751 microversion: 2.20 time: 0.640025 Sep 13 10:18:33.654968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 205/420] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:33 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1751 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:34.684828 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:34.685517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:34.697346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:34.700045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:34.700607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:34.701549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:34.702384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:34.707901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:34.950481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:34.962488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:34.964228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:34.965475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0fb509ac-d958-4e02-9d07-7ee21d15f26d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1751 microversion: 2.20 time: 0.287111 Sep 13 10:18:34.972761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 216/421] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:34 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1751 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:35.994503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:35.995039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:36.002229 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:36.002890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:36.003548 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:36.004547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:36.005010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:36.005442 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:36.287960 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:36.297609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:36.299386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:36.300575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f9904279-7868-4116-9742-161900e02720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1753 microversion: 2.20 time: 0.310577 Sep 13 10:18:36.303274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 206/422] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:35 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1753 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:37.334796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:37.335530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:37.342775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:37.343614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:37.344219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:37.344973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:37.345723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:37.346219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:37.629096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:37.645290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:37.652412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:37.654091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4ed7f6a8-37a7-4c27-a040-c42cc560f9a9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1753 microversion: 2.20 time: 0.323087 Sep 13 10:18:37.678950 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 217/423] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:37 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1753 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:38.682269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:38.683640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:38.692415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:38.693855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:38.694516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:38.695945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:38.696626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:38.698150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:39.003938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:39.016629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:39.018608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:39.020101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0271aa42-b217-4d65-8272-701c8dc9b8d1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.341974 Sep 13 10:18:39.020824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 207/424] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:38 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:40.048125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:40.049872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:40.060076 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:40.064055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:40.064668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:40.065569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:40.066265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:40.066847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:40.307421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:40.330528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:40.340110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:40.340252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-428c1fa6-1794-421e-bfc7-29a34c084e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.297921 Sep 13 10:18:40.342851 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 218/425] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:40 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:41.374152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:41.376164 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:41.407232 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:41.407730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:41.408180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:41.408871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:41.409750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:41.410417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:41.637331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:41.647110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:41.648700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:41.650051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0d036f85-b379-48b2-b6f5-97814940823f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.281913 Sep 13 10:18:41.661571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 208/426] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:41 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:41.972987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5ef036c3-db22-469c-a177-d5f161d16b51 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Action: 'create', calling method: .version_select at 0x7f46c13d0430>, body: {"keypair": {"name": "tempest-TestShelveInstance-336711284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+hCAbw1XeSk7lZlqLb/4j5O62GyChOhyiZNpHb1zFNgBi5Q1NYq9kS5AyGRspptBu1s9mkSy/tSG3fhxTyXser+O+8/l/NWanYauh+mpkSQ2w8hPkTkgnvVoO/14kQNw=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:42.005392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-5ef036c3-db22-469c-a177-d5f161d16b51 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Getting quotas for project 9ef16a5156d9421e85b4106cce719b4f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:18:42.014586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-5ef036c3-db22-469c-a177-d5f161d16b51 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Getting quotas for user 969b244842434bb09642122db0d159c0 and project 9ef16a5156d9421e85b4106cce719b4f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:18:42.039412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:42.039973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:42.051142 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:42.055967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:42.056773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:42.057706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:42.058412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:42.059130 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:42.114831 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5ef036c3-db22-469c-a177-d5f161d16b51 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.430424 Sep 13 10:18:42.116021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 219/427] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:18:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:42.129266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b853de3e-a087-4b56-a767-007688f5fa99 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/ips" status: 200 len: 145 microversion: 2.1 time: 0.107493 Sep 13 10:18:42.129862 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 209/428] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:18:42 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/ips => generated 145 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:18:42.225259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-252062449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-869991838", "security_groups": [{"name": "tempest-secgroup-smoke-1867770006"}], "block_device_mapping_v2": [{"uuid": "58b77162-3d7c-41c9-8de8-7dae5a57cac5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "efbc911f-ad2a-4c68-952b-f6a00ba8476f"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:42.394012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] validate_networks() for [('efbc911f-ad2a-4c68-952b-f6a00ba8476f', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:18:42.681986 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:42.682729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:42.690680 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:42.691597 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:42.700138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:42.700992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:42.701599 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:42.702033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:42.940700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:42.949664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:42.969399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:42.973852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2fb6b5ec-bc0c-4764-a4dd-51125cd635cb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.296445 Sep 13 10:18:42.991418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 210/429] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:42 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:43.117628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:18:43.118280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:18:43.118708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:18:43.119507 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:18:43.119715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:18:43.136642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:43.137433 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:43.138029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:43.138961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:43.139602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:43.140202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:43.166090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:18:43.171700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for user 7ddb2572cac446aa92a0bcf170d9e8d6 and project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:18:43.263477 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:18:43.265994 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58b77162-3d7c-41c9-8de8-7dae5a57cac5',volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:18:43.838600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4653624a-add4-4154-a290-bc4232a55a7d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.618542 Sep 13 10:18:43.839839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 220/430] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:18:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:18:43.851090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a22ec363-d17b-4df7-8bf5-458b8335c689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:43.853102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a22ec363-d17b-4df7-8bf5-458b8335c689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:43.859728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:43.919997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a22ec363-d17b-4df7-8bf5-458b8335c689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:43.940702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a22ec363-d17b-4df7-8bf5-458b8335c689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1093 microversion: 2.1 time: 0.093346 Sep 13 10:18:43.943206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 211/431] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:43 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:44.058285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:44.058285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:44.058285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:44.058285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:44.058604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:44.058604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:44.058604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:44.058604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:44.236782 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:44.248858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:44.253904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:44.255111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-72708c5f-b2ed-4869-b26c-6e811b979e36 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.254455 Sep 13 10:18:44.258844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 221/432] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:43 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:44.969466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2b68570a-a080-47fe-8e36-7dfbb35649d4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:44.971639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2b68570a-a080-47fe-8e36-7dfbb35649d4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:45.037021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2b68570a-a080-47fe-8e36-7dfbb35649d4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:45.044122 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2b68570a-a080-47fe-8e36-7dfbb35649d4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1093 microversion: 2.1 time: 0.080282 Sep 13 10:18:45.045008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 212/433] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:44 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:45.290281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:45.290855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:45.299846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:45.300349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:45.302649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:45.303450 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:45.305828 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:45.306395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:45.618640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:45.618640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:45.619092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:45.619092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b396d1a2-b47f-46ee-b2e0-3157a72297f8 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.323074 Sep 13 10:18:45.619092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 222/434] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:45 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:46.087237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:46.108353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:46.111886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.112387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.112827 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.113547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.114006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.114435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.279834 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5479bded-48b3-433d-b683-19c49f8b6491"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:18:46.282389 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:46.282855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:46.306787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-86a6d646-cd6b-490c-b973-f70b3138afd1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.232633 Sep 13 10:18:46.309533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 213/435] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:46 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:46.319600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.322358 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.322823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.327000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.327512 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.327945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.650469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:46.655717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:46.661925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.662420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.662858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.663604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:46.664090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:46.664518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:46.813015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:46.821989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:46.823497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:46.824687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-502363b3-f0ef-4798-a7ec-9b5fda707393 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.178953 Sep 13 10:18:46.825245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 214/436] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:46 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:47.337540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:47.338921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:47.354718 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:47.364705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:47.364705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:47.364705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:47.364705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:47.365517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:47.480495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:47.491089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-742858d8-b4e2-48ce-b5d0-1a73cae0051a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.157686 Sep 13 10:18:47.492197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 215/437] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:47 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:47.851930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:47.852819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:47.859016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:47.859552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:47.860100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:47.860819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:47.861335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:47.861767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:48.053213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:48.074218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:48.080099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:48.083299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-59b8b73b-d569-421d-a9d2-a4f5db183b33 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.234789 Sep 13 10:18:48.092727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 216/438] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:47 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:48.514551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:48.515256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:48.521859 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:48.522347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:48.522784 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:48.523515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:48.523972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:48.524396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:48.603799 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:48.612439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-baeca5c5-41ac-4a23-8484-6e3a602cff9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.102248 Sep 13 10:18:48.612970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 217/439] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:48 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:49.134963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:49.135610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:49.142631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:49.143421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:49.143861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:49.144753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:49.145300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:49.145929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:49.330295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:49.341957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:49.343428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:49.344603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-57cbaa37-d2bf-4fdb-8329-34e1abffce5e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.214335 Sep 13 10:18:49.345511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 218/440] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:49 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:49.637514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:49.638215 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:49.644555 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:49.645036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:49.645472 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:49.646169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:49.646630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:49.647055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:49.751413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:49.761759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4dba16b7-16fc-4054-bca8-de9e8f17c3fd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.127976 Sep 13 10:18:49.762613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 219/441] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:49 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:50.373319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:50.373964 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:50.380147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:50.380647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:50.381077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:50.381794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:50.382241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:50.382660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:50.827713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:50.838888 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:50.840853 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:50.842316 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-99bd9a5c-ef79-4f22-8ced-225764b7e528 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.473101 Sep 13 10:18:50.843565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 220/442] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:50 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:50.848472 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:50.849158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:50.855309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:50.855920 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:50.856483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:50.857792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:50.858372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:50.859005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:50.924416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:50.932553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1870caef-16a0-49bf-af1f-6619089e1956 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.087650 Sep 13 10:18:50.938708 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 221/443] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:50 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:51.869070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:51.869791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:51.876533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:51.877088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:51.877615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:51.878483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:51.878992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:51.879502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:52.016230 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:52.025169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:52.026617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:52.064060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c74eab25-0491-4b24-980a-cc8db5555ed5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.162696 Sep 13 10:18:52.064060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 222/444] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:51 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:52.064060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:52.064060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:52.064060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:52.064625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:52.064625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:52.064625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:52.064625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:52.064961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:52.104115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:52.112200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0bb8b046-2a61-4b21-8f36-eb45324dcfe7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1143 microversion: 2.1 time: 0.082454 Sep 13 10:18:52.112938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 223/445] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:52 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:53.053958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:53.054557 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:53.060941 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:53.061477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:53.061849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:53.062540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:53.063008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:53.063462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:53.081820 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:53.147292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:53.184390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=10 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:53.195193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:53.205410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:53.206899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:53.210502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-18c849f0-c3e8-4fc2-baec-78383bf5f484 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.158149 Sep 13 10:18:53.210502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 224/446] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:53 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:53.213190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:53.213786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:53.220115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:53.220593 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:53.221026 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:53.221728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:53.222174 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:53.222590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:53.284010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:53.291699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f87fcf94-166e-40e1-8186-3a972979acc7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1135 microversion: 2.1 time: 0.082048 Sep 13 10:18:53.292263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 225/447] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:53 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:53.422228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-59e88fb0-b95f-444c-8e82-c29e2a1de93c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.147058 Sep 13 10:18:53.422858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 223/448] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:18:46 2022] POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments => generated 194 bytes in 7149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:18:54.234771 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:54.235519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:54.241999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:54.242541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:54.243025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:54.243805 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:54.244375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:54.244807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:54.315521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:54.316881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:54.318836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:54.324365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:54.324857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:54.325290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:54.326546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:54.327001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:54.332547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:54.332547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:54.402008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:54.405718 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:54.412083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0e2a2b6e-08e6-4811-a3d8-b627686f4d50 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1135 microversion: 2.1 time: 0.101023 Sep 13 10:18:54.416092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 224/449] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:54 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1135 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:18:54.417363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:54.419989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:54.421641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e66d1588-3fc6-4aac-bf7f-cd4b48612427 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.191586 Sep 13 10:18:54.422190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 226/450] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:54 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:55.437705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:55.438326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:55.447524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:55.447812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:55.448251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:55.448356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:55.448918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:55.449077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:55.449403 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:55.450005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:55.451264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=4 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:18:55.457827 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:55.458300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:55.458734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:55.459466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:55.459917 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:55.460341 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:55.546987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:55.557187 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f02553c1-ca69-49bb-a02d-eb6a9eddbd85 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1135 microversion: 2.1 time: 0.123377 Sep 13 10:18:55.558235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 225/451] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:55 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1135 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:55.616816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:55.626004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:55.627477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:55.628635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d8591965-f2ac-44ac-baaf-24e833cfa874 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.184149 Sep 13 10:18:55.629192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 227/452] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:55 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:56.581844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:56.582579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:56.589568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:56.591868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:56.591868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:56.591868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:56.592178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:56.592604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:56.655194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:56.656274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:56.663357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:56.664999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:56.665550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:56.666367 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:56.666979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:56.667539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:56.681272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:56.689205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5aac9ef4-5a30-4512-a401-e673a2b04b41 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1191 microversion: 2.1 time: 0.111271 Sep 13 10:18:56.689770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 226/453] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:56 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:56.834483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:56.844186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:56.845650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:56.846832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b62c136e-2cc9-46e3-8bfa-732bee5f6d6e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.196846 Sep 13 10:18:56.847420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 228/454] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:56 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:57.711607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:57.712222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:57.718767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:57.719296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:57.719733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:57.720422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:57.720873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:57.721298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:57.788753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:57.797020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8a528bbc-5e07-4569-aab1-744f3f659498 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.089233 Sep 13 10:18:57.797581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 227/455] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:57 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:57.872314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:57.873648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:57.879613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:57.880096 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:57.880526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:57.881209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:57.881659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:57.882079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:58.022288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:58.035360 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:58.038029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:58.039225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3fa6ccca-b3c8-4767-a6fb-f3c828973c0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.170951 Sep 13 10:18:58.039779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 229/456] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:57 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:18:58.820174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:58.820918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:58.827317 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:58.827803 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:58.828239 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:58.828925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:58.829380 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:58.829804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:58.890292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:58.897910 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8129ec73-9b82-4d8a-8d6c-f1bcdc93b8d2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.081521 Sep 13 10:18:58.898467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 228/457] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:58 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:18:59.064311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:59.064925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:59.071393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:59.071879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:59.072323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:59.073010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:59.073474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:59.073901 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:59.205260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:59.213980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:59.215465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:18:59.217284 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-50718a50-7477-44db-8484-eb07885780fa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.156816 Sep 13 10:18:59.217840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 230/458] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:18:59 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:18:59.922017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:18:59.922619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:18:59.929026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:59.929440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:59.929868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:59.930542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:18:59.930983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:18:59.931497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:18:59.994230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:00.002348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-52ff4b9a-87a1-42fd-b688-d5cd640ee7a3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.084664 Sep 13 10:19:00.002911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 229/459] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:18:59 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:00.241830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:00.242475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:00.249040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:00.249528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:00.249969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:00.250662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:00.251119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:00.251591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:00.380657 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:00.389455 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:00.390916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:00.392116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-48ca47b6-fb4a-4475-b6b8-5a45f6065ba7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.154216 Sep 13 10:19:00.392669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 231/460] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:00 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:01.025239 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:01.025804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:01.032781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:01.033266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:01.033707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:01.034406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:01.034863 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:01.035326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:01.098066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:01.105666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9268775e-d734-4548-93ef-a4e4e4008684 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.084501 Sep 13 10:19:01.106219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 230/461] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:01 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:01.418113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:01.418720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:01.425617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:01.426097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:01.426539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:01.427248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:01.427701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:01.428125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:01.556340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:01.565840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:01.567328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:01.568490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-53a930a1-a576-48af-8fc0-7135da06f72d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.154280 Sep 13 10:19:01.569052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 232/462] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:01 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:02.128137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:02.128833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:02.135407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:02.135884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:02.136340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:02.137045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:02.137515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:02.138494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:02.199422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:02.207548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5da51538-48e5-40bb-a9cd-75e9bb7c52c6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.083179 Sep 13 10:19:02.208115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 231/463] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:02 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:02.594445 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:02.595103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:02.602587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:02.603192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:02.603675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:02.604518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:02.605049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:02.605549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:02.735558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:02.744418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:02.745858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:02.747070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c13b5224-f1c6-4413-b46e-78d8234ea900 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.157131 Sep 13 10:19:02.747646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 233/464] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:02 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:03.230854 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:03.231487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:03.238140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:03.238549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:03.238981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:03.239699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:03.240151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:03.240571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:03.300446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:03.307996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b34670b7-72b2-4580-b50a-eaf67eb4cae6 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.081014 Sep 13 10:19:03.308562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 232/465] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:03 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:03.772468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:03.773070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:03.779697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:03.780173 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:03.780626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:03.781315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:03.781763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:03.782180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:03.913031 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:03.922312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:03.923947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:03.925168 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-27090016-12c3-4894-8fd2-71a296ffd01a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.156600 Sep 13 10:19:03.925759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 234/466] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:03 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:04.331745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:04.332304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:04.338553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:04.339025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:04.339480 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:04.340154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:04.340602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:04.341656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:04.408317 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:04.416222 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-467696db-f540-4966-b2ec-e0fd0a8f47fb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.088391 Sep 13 10:19:04.427427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 233/467] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:04 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:04.950016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:04.950551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:04.957538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:04.958024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:04.958463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:04.959175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:04.959636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:04.960069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:05.087863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:05.096415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:05.097898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:05.099071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4523218d-5f11-40e2-b181-2f3ce96f40fc tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.153109 Sep 13 10:19:05.099660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 235/468] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:04 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:05.437908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:05.438513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:05.444988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:05.445469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:05.445903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:05.446597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:05.447051 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:05.447508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:05.508870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:05.520167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-48110c42-cb58-409d-8baf-cde895c8c2b7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.082555 Sep 13 10:19:05.520167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 234/469] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:05 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:06.125422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:06.125930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:06.132483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:06.132968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:06.133404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:06.134100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:06.134558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:06.134988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:06.288129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:06.296722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:06.298184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:06.299376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-00bde99f-c27e-4850-8c43-beedf86a36ce tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.177917 Sep 13 10:19:06.299927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 236/470] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:06 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:06.541151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:06.541767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:06.548529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:06.549012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:06.549445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:06.550155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:06.550796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:06.551244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:06.627909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:06.636018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-30e6e16f-926e-49ad-888f-655d4b723fb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1199 microversion: 2.1 time: 0.099742 Sep 13 10:19:06.636590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 235/471] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:06 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:07.325639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:07.326252 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:07.332659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:07.333145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:07.333587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:07.334287 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:07.334748 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:07.335201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:07.469091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:07.477850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:07.479339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:07.480647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2956bd21-167d-4e6c-8027-8b62be28a8f5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.159248 Sep 13 10:19:07.481055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 237/472] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:07 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:07.662593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:07.663270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:07.669821 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:07.670305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:07.670740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:07.671481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:07.671939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:07.672367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:07.733342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:07.741009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7a642a81-84c7-4ae5-b262-5af29e6a37db tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1209 microversion: 2.1 time: 0.085023 Sep 13 10:19:07.741575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 236/473] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:07 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:08.507568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:08.512050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:08.514799 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:08.515354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:08.515771 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:08.516477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:08.516936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:08.517366 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:08.712464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:08.722783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:08.724356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:08.725535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7f90671b-8f37-4a01-8af8-a449e2d9f731 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.222030 Sep 13 10:19:08.726102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 238/474] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:08 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:08.764453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:08.765091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:08.771479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:08.771954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:08.772382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:08.773135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:08.773590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:08.774008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:08.910345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:08.917992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2904f3d0-b041-4109-8761-ffa4b5417fda tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1277 microversion: 2.1 time: 0.157485 Sep 13 10:19:08.918560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 237/475] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:08 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:09.752349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:09.752955 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:09.759502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:09.759982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:09.760479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:09.761156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:09.761669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:09.762098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:09.890158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:09.898898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:09.900371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:09.901518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a29f2396-cabf-4227-a3eb-1b1814a3afa5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.153080 Sep 13 10:19:09.902080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 239/476] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:09 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:09.940852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:09.941459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:09.947759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:09.948181 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:09.948615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:09.949296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:09.949749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:09.950176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:10.084137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:10.092250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4f05fff0-863a-49f5-896b-55740b9a6977 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1277 microversion: 2.1 time: 0.155324 Sep 13 10:19:10.092997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 238/477] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:09 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:10.928302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:10.928943 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:10.935899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:10.936385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:10.936824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:10.937519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:10.937976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:10.938406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:11.068738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:11.077339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:11.078787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:11.079973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-69be35cc-aee4-4b76-b9a6-82d8c80c141c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.155606 Sep 13 10:19:11.080532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 240/478] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:10 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:11.117695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:11.118421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:11.128645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:11.129123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:11.129551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:11.130234 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:11.130925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:11.131384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:11.264239 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:11.272484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1cfe5653-43c9-4bf2-9042-4ad8c3b45787 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1277 microversion: 2.1 time: 0.159545 Sep 13 10:19:11.273063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 239/479] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:11 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:12.105779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:12.107059 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:12.113232 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.113713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.114143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.114831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.115331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.115751 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.120002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:12.278146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:12.292131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:12.292131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:12.292131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9348104b-6eaf-49fc-8aa4-a78f68302a6a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.187867 Sep 13 10:19:12.292480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 241/480] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:12 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:12.296333 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:12.296945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:12.302835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.303360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.303807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.304488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.304945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.305367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.399433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3", "tag": "6cb2c144-20ad-4b64-bae8-d285863ef58e"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:12.409610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.410314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.410817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.422156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] Creating event network-changed:6cb2c144-20ad-4b64-bae8-d285863ef58e for instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 on hv-cinder-85427 Sep 13 10:19:12.427299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-fe8001bf-af92-4f6c-8671-2b311c3a1aaa req-03e9c077-333c-4de9-b0e7-ff806343092e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Sep 13 10:19:12.427976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 242/481] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:19:12.522331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:12.524685 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:12.531355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c4ce6169-6498-4935-bc35-4ee2dafbab79 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1277 microversion: 2.1 time: 0.239209 Sep 13 10:19:12.532059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 240/482] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:12 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:12.671495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:12.677694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.678184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.678621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.739466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Going to try to stop instance {{(pid=121003) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 10:19:12.953035 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1d78bdef-27d7-4a22-9fc4-60a672943f3d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action" status: 202 len: 0 microversion: 2.1 time: 0.287274 Sep 13 10:19:12.954065 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 243/483] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:19:12 2022] POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:19:12.968911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:12.969917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:12.980648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.981193 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.982256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:12.983297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:12.983754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:12.984178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.198311 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:13.214901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-51321d49-c7e9-4fdc-ad7b-3acb8f5e2db6 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.248389 Sep 13 10:19:13.214901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 241/484] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:12 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:13.320870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:13.320870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:13.322727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:13.323265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:13.323709 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.324411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:13.325370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:13.325840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.520816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:13.533623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:13.533623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:13.533623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-05696df4-ed72-4252-97c6-5bac1980b1b5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.222441 Sep 13 10:19:13.534016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 244/485] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:13 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:13.557218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:13.557845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:13.564751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:13.565271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:13.565752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.566452 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:13.566904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:13.567369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.713743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:13.722636 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6b61dc47-fd1a-4ff8-8b44-ad02250abce3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.171162 Sep 13 10:19:13.723373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 242/486] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:13 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:13.743854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "name": "network-vif-plugged", "status": "completed", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:13.753669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:13.754147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:13.754569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:13.765958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] Creating event network-vif-plugged:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:19:13.770770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-70d2ce39-2118-4d2b-ae26-3c96be43a9ef req-48a055f8-4da5-4314-9aae-5364ab391f9d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034141 Sep 13 10:19:13.771378 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 245/487] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:14.230145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:14.230677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:14.237135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.237619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.238055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:14.238741 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.239220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.239647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:14.365250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:14.373943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bc3b6a73-5dd3-4091-82e3-1a807180e4a8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.147810 Sep 13 10:19:14.374500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 243/488] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:14 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:14.509491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1090862039", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-336711284", "security_groups": [{"name": "tempest-secgroup-smoke-1288908700"}], "networks": [{"uuid": "7f63c816-53c2-40cc-b606-323a65ea3386"}], "block_device_mapping_v2": [{"uuid": "22ba9e4f-5592-4f16-934a-b09850e54925", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:14.562228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:14.562873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:14.568956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.569442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.569881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:14.570616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.579144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.579688 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:14.637606 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] validate_networks() for [('7f63c816-53c2-40cc-b606-323a65ea3386', None, None, None, None, None)] {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:19:14.870531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:14.880481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:14.882836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:14.884112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4e30c5be-a674-494f-b8de-328bfbf2ceaa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.327010 Sep 13 10:19:14.884908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 244/489] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:14 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:14.890103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:14.890717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:14.901993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.901993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.901993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:14.901993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:14.902363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:14.902363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.341245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:15.349019 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8cd79ce9-9dac-495a-ba4e-48f8d5e8c81e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.462847 Sep 13 10:19:15.349597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 245/490] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:14 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:15.397106 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:15.398030 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:15.404213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.404695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.405127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.405832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.406281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.406699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.454158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:19:15.454586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:19:15.455063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:19:15.455511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:19:15.456208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:19:15.465600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.466188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.466697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.467729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.468257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.468918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.485580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Getting quotas for project 9ef16a5156d9421e85b4106cce719b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:19:15.489703 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Getting quotas for user 969b244842434bb09642122db0d159c0 and project 9ef16a5156d9421e85b4106cce719b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:19:15.538432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:15.548027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d773ff27-8bf3-441a-bbde-ac3f3698767c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.154747 Sep 13 10:19:15.548633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 246/491] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:15 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:15.548856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:19:15.550917 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22ba9e4f-5592-4f16-934a-b09850e54925',volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:19:15.910253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:15.910896 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:15.917460 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.918147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.919143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.919881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:15.920452 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:15.920739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:15.985738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-499d2aaa-fc23-4ed4-a5c6-9583ffc096af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.481140 Sep 13 10:19:15.986435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 246/492] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:19:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:19:15.997776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b53a7f96-5ce5-4649-acc9-5c0b76cdbc78 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:15.998399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b53a7f96-5ce5-4649-acc9-5c0b76cdbc78 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:16.067660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b53a7f96-5ce5-4649-acc9-5c0b76cdbc78 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.079946 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b53a7f96-5ce5-4649-acc9-5c0b76cdbc78 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1088 microversion: 2.1 time: 0.085860 Sep 13 10:19:16.082768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 247/493] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:15 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:16.098553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.108456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.109751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.110904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-48580020-3285-4d74-a2d3-6b9a30634ad9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.204738 Sep 13 10:19:16.111734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 247/494] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:15 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:19:16.372511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:16.373022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:16.374996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:16.379900 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:16.380389 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:16.380832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:16.381534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:16.381993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:16.382424 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:16.514420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.522292 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-22fd9a76-c70b-4721-a671-631741882f86 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.153963 Sep 13 10:19:16.522856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 248/495] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:16 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:16.574072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:16.575410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:16.583607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:16.584092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:16.584522 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:16.585214 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:16.585829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:16.586257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:16.722469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:16.731237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-89820781-ca47-4adf-88bc-9372613727eb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.163169 Sep 13 10:19:16.731814 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 248/496] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:16 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:17.105219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:17.106377 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:17.115511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.116046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.116467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.117099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.117547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.117975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.139574 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:17.140797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:17.151274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.152035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.152632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.154740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.155404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.155897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.191260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.199005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-902b31dc-5c29-4f6c-b7f2-f7b3f3c8e335 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1138 microversion: 2.1 time: 0.097594 Sep 13 10:19:17.199638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 249/497] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:17 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:17.289044 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.298486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.299948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.301093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1ed9a756-a6fd-40bf-9791-16ae9c9e0314 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1809 microversion: 2.20 time: 0.168505 Sep 13 10:19:17.301641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 249/498] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:17 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:19:17.548789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:17.549405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:17.555984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.556481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.556925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.557627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.558091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.558514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.690896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.699663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bf6e5a77-f1ae-40b2-bc20-8ae105308775 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.154639 Sep 13 10:19:17.700241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 250/499] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:17 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:17.756751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:17.756974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:17.763804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.764267 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.764700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.765395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:17.765847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:17.766269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:17.909487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:17.917899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-00553473-317c-416f-9151-bc1fecb8cc7a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.166546 Sep 13 10:19:17.918884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 250/500] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:17 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:18.221982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:18.222583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:18.228962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.229454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.229893 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.230588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.231045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.231535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.292402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:18.300029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-34ce2d39-00a1-4702-a0aa-a25ad8262433 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1186 microversion: 2.1 time: 0.081907 Sep 13 10:19:18.300594 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 251/501] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:18 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:18.326992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:18.327621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:18.333586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.334064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.334496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.335191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.335646 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.336069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.468291 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:18.481215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:18.482674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:18.483873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dc23c569-b4bd-448d-870a-8ea03cc69c02 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1796 microversion: 2.20 time: 0.161602 Sep 13 10:19:18.484428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 251/502] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:19:18 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:19:18.723620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:18.724512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:18.731639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.732461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.732984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.733755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.734285 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.734722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.941445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:18.942785 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:18.953848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.956129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:18.956926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.957388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.958121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:18.958587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:18.959417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:18.969561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4a69c9ee-cb47-4574-8d87-dfe34244f753 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.249710 Sep 13 10:19:18.970140 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 252/503] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:18 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:19.169409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:19.177750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9a8f24ef-1bea-41f7-a8b5-2d25dca2528c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.240529 Sep 13 10:19:19.178315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 252/504] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:18 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:19.323950 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:19.325227 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:19.331700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:19.332290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:19.332792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:19.333700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:19.334289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:19.334804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:19.408239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:19.416016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7fc39c7a-4948-4a98-8959-8ecfce47f9ef tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1204 microversion: 2.1 time: 0.096469 Sep 13 10:19:19.416591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 253/505] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:19 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:19.993076 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:19.993687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:20.000525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.001010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.001445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.002131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.002588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.003016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.132037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:20.139593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-98421536-856b-42e0-942b-e127792e1eee tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.150452 Sep 13 10:19:20.140153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 253/506] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:19 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:20.201082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:20.201691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:20.208241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.208760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.209197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.209882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.210339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.210766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.342299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:20.350910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a887f1b7-9fd6-4746-a65f-cb2f255bd918 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.153761 Sep 13 10:19:20.351517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 254/507] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:20 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:20.444576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:20.445179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:20.451009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.451523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.451974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.452656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:20.453100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:20.453518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:20.704654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:20.712401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9f93ea72-0037-4a57-b0e9-d19401362762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1272 microversion: 2.1 time: 0.271703 Sep 13 10:19:20.712981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 254/508] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:20 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:21.163669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:21.164255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:21.170744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.174303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.174303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.174303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.174303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.174724 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.208941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:21.219496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.219974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.220397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.232386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] Creating event network-changed:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:19:21.238208 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-305a76c5-4627-4171-bed2-4bb221772937 req-434e7921-9eb3-4d3c-9d27-e45adbf84f80 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032705 Sep 13 10:19:21.239148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 255/509] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:21.375928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:21.376830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:21.384995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.385179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.385759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.386583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.387127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.387756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.448425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:21.456272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8bc41e36-613c-480c-bad3-d18e437e58cc tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.296439 Sep 13 10:19:21.456854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 255/510] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:21 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:21.610155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:21.618777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a0855070-2aa5-43aa-8ae0-c7afe0e56e20 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.247202 Sep 13 10:19:21.621554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 256/511] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:21 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:21.736823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:21.737543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:21.743671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.744410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.744855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.745558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:21.746027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:21.746438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:21.944029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:21.952868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b8ef5621-8e8f-4e69-b824-0daaebeb2a47 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.219865 Sep 13 10:19:21.968702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 256/512] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:21 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:22.480125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:22.481257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:22.487568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.488056 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.488491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.489179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.489635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.490066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.626989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:22.634570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-905f6645-0ff5-405a-a0b1-433513276996 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.158583 Sep 13 10:19:22.635247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 257/513] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:22 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:22.641599 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:22.642295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:22.648742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.649224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.649658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.650373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.650828 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.651276 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.781646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:22.789855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2c2d7875-b6b3-4b53-82d8-edbf61226bba tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.152066 Sep 13 10:19:22.790414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 257/514] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:22 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:22.976300 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:22.976871 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:22.983515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.983997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.984432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.985118 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:22.985574 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:22.985999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:22.988645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:23.116412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:23.126452 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e731f895-8b3a-496d-a89d-7fe90df098cf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.153823 Sep 13 10:19:23.127503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 258/515] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:22 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:23.657889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:23.658400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:23.665010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:23.666348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:23.666348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:23.666635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:23.667068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:23.667514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:23.803368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:23.805802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3", "name": "network-vif-plugged", "status": "completed", "tag": "6cb2c144-20ad-4b64-bae8-d285863ef58e"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:23.814172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8ef7801e-726c-45f8-b03a-6de5e4800689 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.160436 Sep 13 10:19:23.814903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 258/516] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:23 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:23.816801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:23.817289 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:23.817727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:23.820146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:23.820978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:23.826874 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:23.827527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:23.828008 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:23.828772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:23.829301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:23.829492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] Creating event network-vif-plugged:6cb2c144-20ad-4b64-bae8-d285863ef58e for instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 on hv-cinder-85427 Sep 13 10:19:23.829866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:23.836561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-098318d1-0c54-4cc5-9f6a-990ffdbdc485 req-a629966a-0b67-4fb4-a5b1-fe2b24d28262 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Sep 13 10:19:23.837149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 259/517] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:23.968163 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:23.971821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:23.976456 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-08900565-c756-494c-ba4b-ba06d6f19309 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.160528 Sep 13 10:19:23.977237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 259/518] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:23 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:24.151872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:24.153088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:24.159536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:24.160061 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:24.160437 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:24.161127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:24.161576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:24.161996 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:24.371618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:24.380675 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-62b3b4aa-3670-4ff5-ae48-ecbd34be76a6 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.234641 Sep 13 10:19:24.381260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 260/519] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:24 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:24.840723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:24.841343 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:24.848541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:24.849042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:24.849468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:24.850162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:24.850617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:24.851048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:24.985446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:24.993148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8b4cc6c0-c277-41f1-b3c4-261363f7c628 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.157024 Sep 13 10:19:24.993723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 260/520] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:24 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:25.000120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:25.000734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:25.007344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:25.007831 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:25.008265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:25.008950 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:25.009407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:25.009833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:25.136465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:25.144694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a1bdb5ec-1d8c-482a-89d6-be8529629d9f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.148856 Sep 13 10:19:25.145263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 261/521] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:24 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:25.404483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:25.405094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:25.411074 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:25.411584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:25.412018 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:25.412700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:25.413152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:25.413575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:25.475936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:25.550181 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:25.558214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8f4badae-a8e4-4db1-875f-1742c1b782a5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.158456 Sep 13 10:19:25.558814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 261/522] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:25 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:26.017158 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:26.017703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:26.020107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=76 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:26.024803 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.028848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.028848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.028848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.028848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.029261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.158488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:26.166170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0aa90368-d2c1-4593-8d07-a971d2e97788 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1265 microversion: 2.1 time: 0.152907 Sep 13 10:19:26.166733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 262/523] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:26 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:26.169472 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:26.170172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:26.173594 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=8 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:26.177157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.177659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.178102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.178808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.179299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.185583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.316669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:26.325043 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-937bba21-2319-4d2c-804a-7fe6e6b89b80 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.160093 Sep 13 10:19:26.325604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 262/524] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:26 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:26.581278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:26.581782 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:26.587841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.588321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.588758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.589455 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:26.590394 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:26.590818 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:26.730350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:26.738749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-57734331-f70d-4e66-92e6-815bc24e2d9c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.161713 Sep 13 10:19:26.739307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 263/525] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:26 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:27.189680 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:27.190220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:27.196225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.196707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.197138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.197819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.198270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.198695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.332603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:27.340412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3b379b5c-c0ae-40f4-8a6d-5fb3e52cad42 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1452 microversion: 2.1 time: 0.154812 Sep 13 10:19:27.340978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 263/526] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:27 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:27.347847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:27.348462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:27.354804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.355316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.355750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.356428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.356874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.357372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.362033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:27.362700 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:27.368483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.368963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.369395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.370083 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.370540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.370962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.779390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:27.787525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d6c02081-6e14-4e9c-96e5-b7fff62c27ef tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.443371 Sep 13 10:19:27.788094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 264/527] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:27 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:27.792561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:27.793655 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:27.799408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.799973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.800418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.801118 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:27.801584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:27.802007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:27.804106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:27.813057 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-94c4f1d4-2aa0-4665-9cdd-4836e5d41762 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1452 microversion: 2.1 time: 0.454622 Sep 13 10:19:27.816188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 264/528] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:27 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1452 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:27.937535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:27.946673 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e3dbfdc7-f17e-46d1-ba8e-3d428bcb947d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.157613 Sep 13 10:19:27.947250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 265/529] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:27 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:28.812392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:28.812954 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:28.819963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:28.820489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:28.820913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:28.821609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:28.822137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:28.822578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:28.969797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:28.970398 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:28.976788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:28.977207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:28.977633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:28.978312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:28.978758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:28.979223 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:29.062890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:29.071185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-62b7520e-c9a0-474b-bb4b-e963038e28b0 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.263218 Sep 13 10:19:29.071743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 265/530] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:28 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:29.155411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:29.162937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-31fb1744-b37e-436c-be56-5d9ba047d1cc tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.196911 Sep 13 10:19:29.163528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 266/531] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:28 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:30.025002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3", "tag": "6cb2c144-20ad-4b64-bae8-d285863ef58e"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:30.036404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:30.037076 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:30.037517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:30.048513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] Creating event network-changed:6cb2c144-20ad-4b64-bae8-d285863ef58e for instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 on hv-cinder-85427 Sep 13 10:19:30.053602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-6bfce8ed-fc11-41bf-bb50-d3ba4e9ae2d0 req-a7ea803b-7187-4164-aba5-2f60f83714e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032469 Sep 13 10:19:30.054189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 266/532] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:19:30.094572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:30.095205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:30.102998 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:30.103516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:30.104125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:30.104824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:30.105288 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:30.105704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:30.187824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:30.189033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:30.196167 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:30.196814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:30.197368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:30.198186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:30.198752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:30.199990 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:30.378329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:30.397752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-323d9cb3-3d60-4f66-86a2-17441e1d00aa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.307516 Sep 13 10:19:30.398554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 267/533] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:30 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:30.452066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:30.459959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6ab8704f-9a48-4ab0-bf7d-7c0ea8d43eaf tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.277586 Sep 13 10:19:30.475068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 267/534] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:30 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:31.421852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:31.422396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:31.428872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:31.429378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:31.429835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:31.430511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:31.430961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:31.431411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:31.481874 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:31.482485 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:31.489315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:31.489804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:31.490241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:31.491294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:31.491757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:31.492187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:31.605515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:31.614886 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4ade7f8a-1a07-40ee-be49-1e2b98cda8e4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.196857 Sep 13 10:19:31.615500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 268/535] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:31 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:31.656129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:31.664252 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3da4077c-b667-4411-83d6-e9fe12731c0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.186238 Sep 13 10:19:31.664820 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 268/536] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:31 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:31.992973 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be145950-e3ea-43af-bf00-05c984ff459d"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:31.995501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:32.002147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.003651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.003651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.004286 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.004747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.005197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.228116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "name": "network-vif-plugged", "status": "completed", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:32.238290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.242159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.242159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.252720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] Creating event network-vif-plugged:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:19:32.257631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-ce837e8e-d84b-455f-a34f-b4dcc8f9a093 req-895d1fe2-128f-428c-95cc-5b9e47f77e9a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033291 Sep 13 10:19:32.258205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 269/537] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:19:32.638760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:32.639495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:32.646249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.646742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.647197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.647904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.648364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.654776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.755313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9e98c049-6a8e-48a5-ac09-806a27105941 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766320 Sep 13 10:19:32.756617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 269/538] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:19:31 2022] POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:32.762930 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:32.767597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:32.772807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.773468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.774084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.774979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:32.775465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:32.775895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:32.859368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:32.867634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bbffa959-96f9-4bd2-b813-731d25d11276 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.233232 Sep 13 10:19:32.868200 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 270/539] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:32 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:32.925873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:32.933529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-94540944-2df2-46fc-979f-e87f879c9d3f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.175078 Sep 13 10:19:32.934094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 270/540] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:32 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:33.890210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:33.890832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:33.897495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:33.897984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:33.898422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:33.899117 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:33.899600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:33.900030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:33.956009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:33.956775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:33.963096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:33.963608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:33.964039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:33.965313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:33.965770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:33.966194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:34.078466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:34.088941 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-64f89479-9061-4103-bbfd-56df4f192cb9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1722 microversion: 2.1 time: 0.202389 Sep 13 10:19:34.089594 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 271/541] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:33 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:34.125159 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:34.132858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-24944ba7-e2e5-4eab-ab42-b6c7801d1cec tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1260 microversion: 2.1 time: 0.180727 Sep 13 10:19:34.133417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 271/542] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:33 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:35.112231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:35.112828 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:35.119698 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.120196 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.120713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.121499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.121963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.122396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.157320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:35.157940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:35.164447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.164934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.165374 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.166240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.166622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.167046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.300061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:35.308194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0305478b-2868-4a5e-bbd0-58e31a0af693 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1699 microversion: 2.1 time: 0.200023 Sep 13 10:19:35.308972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 272/543] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:35 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1699 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:35.330847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:35.331198 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:35.337226 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.337706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.338136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.338699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-af9cb331-e1e6-436e-bf23-efc11030ad5d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1445 microversion: 2.1 time: 0.186263 Sep 13 10:19:35.339283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 272/544] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:35 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1445 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:35.360514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Going to try to start instance {{(pid=121003) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 10:19:35.361386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:35.362007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:35.367845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.368266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.368698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.369384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.369832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.370254 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.501765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:35.509494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-87faa531-ffa8-4b85-af6f-a3080d23a0ff tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1445 microversion: 2.1 time: 0.151821 Sep 13 10:19:35.510278 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 273/545] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:35 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:35.578304 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5ac22ad9-358e-402b-9aec-8ad7abb6f517 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action" status: 202 len: 0 microversion: 2.1 time: 0.250691 Sep 13 10:19:35.578910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 273/546] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:19:35 2022] POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 10:19:35.587119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:35.587758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:35.593743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.599387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.599387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.599387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:35.599387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:35.599787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:35.600524 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:35.759786 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:35.770067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-936852df-3715-4c97-83aa-450b878941b3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1708 microversion: 2.1 time: 0.186845 Sep 13 10:19:35.771154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 274/547] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:35 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1708 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:36.795716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:36.796426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:36.803648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:36.803755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:36.804136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:36.805023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:36.805661 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:36.806095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:36.938818 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:36.947370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ca314092-1719-4b76-8892-8d672641afe9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1708 microversion: 2.1 time: 0.157077 Sep 13 10:19:36.947969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 274/548] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:36 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:37.587026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:37.598401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:37.598959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:37.599505 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:37.610354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] Creating event network-changed:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:19:37.615122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-fe4a2150-6511-43c9-adc0-3bff0a4926c7 req-65073d21-abd6-4f17-a961-5838ef8e149b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 Sep 13 10:19:37.615782 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 275/549] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:37.952460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:37.952940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:37.959600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:37.960188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:37.960630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:37.961391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:37.961856 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:37.962290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:37.973314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:37.976390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:37.984792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:37.989885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:37.989885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:37.989885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:37.990177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4dcfea04-3700-4649-a4e6-eb4cc4a37933 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/ips" status: 200 len: 149 microversion: 2.1 time: 0.038655 Sep 13 10:19:37.990293 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:37.990400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 275/550] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:19:37 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:37.990491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.002059 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1edb1e09-9405-4cf4-acba-bd825187d4ef"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:38.004926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:38.010990 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.013138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.014070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.015058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.015761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.016373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.104847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: POST /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/os-volume_attachments HTTP/1.1 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 74 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:19:38.108003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {"volumeAttachment": {"volumeId": "1edb1e09-9405-4cf4-acba-bd825187d4ef"}} Sep 13 10:19:38.109604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'server_id': 'cd48156b-79bf-41ef-8a3d-3b5265dae93c', 'body': {'volumeAttachment': {'volumeId': '1edb1e09-9405-4cf4-acba-bd825187d4ef'}}} Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:38.110514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:38.111988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:38.113622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:38.113622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:19:38.113622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:19:38.113622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 Sep 13 10:19:38.113622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:38.115368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 400 to user: Invalid volume: volume 1edb1e09-9405-4cf4-acba-bd825187d4ef is already attached to instances: 35bddc8a-d8db-4078-83a2-6149b951e279 {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:19:38.116408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2d42b59d-a3f6-4ac2-8e14-01946c7b8276 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118906 Sep 13 10:19:38.117428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 276/551] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:19:37 2022] POST /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:19:38.129694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:38.130389 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:38.137958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.138572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.139120 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.139959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.140527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.141067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.147636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:38.186739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:19:38.232305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:38.241754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8d41c363-752e-44da-b5c6-10cc5b95e40c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1708 microversion: 2.1 time: 0.275522 Sep 13 10:19:38.246677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 276/552] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:37 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1708 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:38.491365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3ae41a34-567f-4e30-978a-a4129dc704ce tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 204 len: 0 microversion: 2.1 time: 0.367563 Sep 13 10:19:38.492057 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 277/553] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:19:38 2022] DELETE /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:19:38.500303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:38.500906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:38.506786 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.507302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.507739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.508423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:38.508875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:38.509298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:38.643776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:38.656003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-163ebc64-5f35-4eb3-ae0a-cb4b8c078505 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1682 microversion: 2.1 time: 0.159331 Sep 13 10:19:38.656585 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 277/554] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:38 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:39.266548 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:39.267290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:39.273623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:39.274138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:39.274580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:39.275301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:39.275763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:39.276206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:39.408538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:39.418887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-25f7a839-ec21-42ad-a0c7-684e8efdc971 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1712 microversion: 2.1 time: 0.154496 Sep 13 10:19:39.418887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 278/555] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:39 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:39.679110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:39.679689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:39.686815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:39.687328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:39.687767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:39.688451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:39.688900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:39.689324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:39.816731 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:39.824491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-34c5f709-8339-4de4-bf69-5a6fb338d619 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1682 microversion: 2.1 time: 0.149277 Sep 13 10:19:39.825050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 278/556] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:39 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:40.847718 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:40.848322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:40.854705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:40.855372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:40.855826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:40.856515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:40.856966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:40.857410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:40.986865 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:40.994719 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5858649b-35d3-49dc-8512-8c28a92f71c7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1682 microversion: 2.1 time: 0.150875 Sep 13 10:19:40.995312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 279/557] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:40 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:42.018125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:42.018736 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:42.025129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:42.025641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:42.026079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:42.027479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:42.027943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:42.028628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:42.251733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:42.259352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-385e1391-e360-45e4-ae33-c436479e638a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1682 microversion: 2.1 time: 0.245035 Sep 13 10:19:42.259917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 279/558] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:42 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:43.081537 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd48156b-79bf-41ef-8a3d-3b5265dae93c", "name": "network-vif-deleted", "tag": "3f20d233-f49a-4ba0-bc07-8628d35a3d2c"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:43.102707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.103207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.104063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.116150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] Creating event network-vif-deleted:3f20d233-f49a-4ba0-bc07-8628d35a3d2c for instance cd48156b-79bf-41ef-8a3d-3b5265dae93c on hv-cinder-85427 Sep 13 10:19:43.123791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-6f612f62-e8f4-4b62-afbb-5303cee3ae3b req-170f028c-a476-489a-b20f-ef212b3c889f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046098 Sep 13 10:19:43.124566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 280/559] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:43.287531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:43.288813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:43.296810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.297357 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.297797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.298496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.298946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.299401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.364152 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:43.374386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a114cbb5-b265-4f5f-b612-0f8f32df6dcb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1327 microversion: 2.1 time: 0.092825 Sep 13 10:19:43.375588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 280/560] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:43 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:43.537425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:43.539966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:43.546848 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.547512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.549500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.550225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.550687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.551158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.575930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'flavor' on Instance uuid dcbf82b8-a33f-49ca-940c-951590122eba {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:19:43.975119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b2e51af1-1d97-4459-95cf-60c634ef7386 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/action" status: 200 len: 32 microversion: 2.1 time: 0.442293 Sep 13 10:19:43.976263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 281/561] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:19:43 2022] POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:19:43.986707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:43.987367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:43.993777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.994266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.994704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:43.995464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:43.995921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:43.996354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:44.137320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:44.147057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cca3a5b0-3445-45bd-9b0d-a8921e58b29f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.164361 Sep 13 10:19:44.147789 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 281/562] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:43 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:44.398990 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:44.400385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:44.408817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:44.409394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:44.409930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:44.410843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:44.411889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:44.412473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:44.450528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:44.451108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:44.451660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:44.452295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'fault' on Instance uuid cd48156b-79bf-41ef-8a3d-3b5265dae93c {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:19:44.499702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:44.508121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5219411d-93ff-4e4c-96bb-11bd33213ab5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 200 len: 1332 microversion: 2.1 time: 0.113567 Sep 13 10:19:44.508744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 282/563] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:44 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:45.171936 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:45.172492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:45.178770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:45.179270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:45.179703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:45.180384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:45.180832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:45.181251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:45.312045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:45.320287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8ca37969-e19b-46c5-b657-d2e14571a05c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.152904 Sep 13 10:19:45.320859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 282/564] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:45 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:45.533688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:45.534419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:45.541004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:45.541496 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:45.541938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:45.543347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:45.543807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:45.544236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:45.558167 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c HTTP/1.1 Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:19:45.560066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:19:45.561451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'cd48156b-79bf-41ef-8a3d-3b5265dae93c'} Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:19:45.562150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:19:45.563310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:19:45.565006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:19:45.565006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1a0a216f-c262-4517-8017-dde16adab077 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 404 len: 111 microversion: 2.1 time: 0.031846 Sep 13 10:19:45.565006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 283/565] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:45 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:19:45.575879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c861c2c6-3624-46ce-8bb7-758f7beb16df tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '.version_select at 0x7f46c10f0e50>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:45.686376 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c861c2c6-3624-46ce-8bb7-758f7beb16df tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229799980" status: 202 len: 0 microversion: 2.1 time: 0.114813 Sep 13 10:19:45.686992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 283/566] 10.222.0.62 () {58 vars in 1221 bytes} [Tue Sep 13 10:19:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229799980 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:19:46.345152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:46.345912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:46.356045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.356577 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.357022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.357744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.358205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.358633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.509908 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:46.510410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:46.513268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:46.517241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.517939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.518543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.519451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.520062 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.520642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.522066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c4d4b495-b089-4595-a1a7-119760fa6a61 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.182790 Sep 13 10:19:46.522631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 284/567] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:46 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:46.644405 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'services' on Instance uuid 35bddc8a-d8db-4078-83a2-6149b951e279 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:19:46.921895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b58361b0-f0c7-4d54-b6b0-88c34f9dc7ff tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments/1edb1e09-9405-4cf4-acba-bd825187d4ef" status: 202 len: 0 microversion: 2.1 time: 0.415764 Sep 13 10:19:46.922415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 284/568] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:19:46 2022] DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments/1edb1e09-9405-4cf4-acba-bd825187d4ef => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 10:19:46.930808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:46.933161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:46.935669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:46.940584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.941080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.941521 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.942382 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:46.942839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:46.943330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:46.974175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-85de142b-a67d-4fa5-9943-ba0c3eeff499 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047330 Sep 13 10:19:46.974730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 285/569] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:19:46 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:47.546944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:47.547660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:47.553795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:47.554280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:47.554713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:47.555488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:47.555939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:47.556360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:47.704498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:47.712802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5ab127c5-d441-4efb-a88b-b2752c5a6b2d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.170652 Sep 13 10:19:47.713366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 285/570] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:47 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:47.994767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:47.997490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:48.003855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:48.004345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:48.004785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:48.005485 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:48.005948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:48.006377 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:48.037403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7a1f8a50-40c7-408b-874a-cb823816e3e3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048161 Sep 13 10:19:48.037957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 286/571] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:19:47 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:48.736091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:48.736755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:48.743100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:48.743607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:48.744038 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:48.744735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:48.745162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:48.745581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:48.873203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:48.881343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8c3d9887-3589-414f-acd4-1dce4e971e5e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.149152 Sep 13 10:19:48.881901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 286/572] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:48 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:49.050474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:49.052691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:49.059594 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.060080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.060527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.061218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.061678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.062136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.091079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-382c66c3-2254-4330-9f1a-5868bb564408 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044642 Sep 13 10:19:49.091649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 287/573] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:19:49 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:19:49.154280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:49.154778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:49.160598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.161088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.161523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.162212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.162665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.163092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.188981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:19:49.434212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9a26106e-5027-487c-ab24-036241308a1f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 204 len: 0 microversion: 2.1 time: 0.283718 Sep 13 10:19:49.434887 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 287/574] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:19:49 2022] DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:19:49.443205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:49.443817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:49.449789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.450259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.450690 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.451405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.451891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.452313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.582440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:49.590120 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ab8d1a02-32fb-454b-96dd-2870467f7c41 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1679 microversion: 2.1 time: 0.150744 Sep 13 10:19:49.590674 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 288/575] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:49 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:49.905355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:49.906081 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:49.912565 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.913072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.913499 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:49.914175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:49.914620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:49.915060 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:50.041598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:50.050333 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-490f41ea-05c2-44a5-86c3-529ae0d3533d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.149959 Sep 13 10:19:50.050889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 288/576] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:49 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:50.614505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:50.615105 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:50.622079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:50.622551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:50.622981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:50.623687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:50.624136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:50.624554 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:50.753020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:50.761321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-dd519f0a-32f0-4b4c-9fd8-7a299bc927d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1679 microversion: 2.1 time: 0.151030 Sep 13 10:19:50.761886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 289/577] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:50 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:51.072210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:51.072798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:51.079136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:51.079639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:51.080065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:51.080737 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:51.081182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:51.081597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:51.211813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:51.220491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5e3a725a-9cc3-41d7-ad74-0b34285e835c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.152103 Sep 13 10:19:51.221359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 289/578] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:51 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:51.785230 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:51.785845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:51.792253 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:51.792739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:51.793176 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:51.793875 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:51.794485 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:51.794915 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:51.985095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:51.993261 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-22a69327-cbb5-4789-a0cf-dc99720962b2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1679 microversion: 2.1 time: 0.211895 Sep 13 10:19:51.993943 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 290/579] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:51 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:52.244049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:52.244653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:52.250797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:52.251300 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:52.251729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:52.252405 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:52.252851 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:52.253270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:52.255990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:52.721643 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:52.722108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bddc8a-d8db-4078-83a2-6149b951e279", "name": "network-vif-deleted", "tag": "2fbabe17-010d-4901-979a-668fa9e70da2"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:52.730312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-db8b7938-fd9c-41c2-959d-af8c4d206302 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.489977 Sep 13 10:19:52.732996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:52.733482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:52.733911 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:52.739396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 290/580] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:52 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:52.739528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:52.745918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] Creating event network-vif-deleted:2fbabe17-010d-4901-979a-668fa9e70da2 for instance 35bddc8a-d8db-4078-83a2-6149b951e279 on hv-cinder-85427 Sep 13 10:19:52.751607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-67eb52c9-c9f5-48f8-bc6d-13214cd071db req-d33fdd5d-b449-4099-9fd1-c33ef662377e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Sep 13 10:19:52.752296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 291/581] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:19:53.017979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:53.018660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:53.024656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:53.025147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:53.025583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:53.026272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:53.026715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:53.027130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:53.093423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:53.101033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0fcade58-6a13-4de7-aa61-168598c44fba tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 200 len: 1326 microversion: 2.1 time: 0.087020 Sep 13 10:19:53.101586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 291/582] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:53 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:53.756648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:53.757383 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:53.764826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:53.767307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:53.767307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:53.767307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:53.767307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:53.767711 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:53.902110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:53.911449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d7db1f6f-f31b-406f-91a3-35f2bad24f26 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.161138 Sep 13 10:19:53.912022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 292/583] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:53 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:54.124474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:54.125020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:54.131400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:54.131877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:54.132302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:54.132979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:54.133448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:54.133867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:54.147801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 HTTP/1.1 Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:19:54.149426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:19:54.150986 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '35bddc8a-d8db-4078-83a2-6149b951e279'} Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:19:54.156101 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:19:54.157561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:19:54.158922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:19:54.158922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-22a2a9de-19ca-4e8f-ad4a-181fcc493375 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 404 len: 111 microversion: 2.1 time: 0.030721 Sep 13 10:19:54.158922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 292/584] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:54 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:19:54.160335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4e482bfd-cafd-4226-9847-c376a897b9e1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '.version_select at 0x7f46c10a0e50>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:54.234134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4e482bfd-cafd-4226-9847-c376a897b9e1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570581588" status: 202 len: 0 microversion: 2.1 time: 0.077724 Sep 13 10:19:54.234710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 293/585] 10.222.0.62 () {58 vars in 1218 bytes} [Tue Sep 13 10:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570581588 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:19:54.937586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:54.938230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:54.944342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:54.944833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:54.945269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:54.945967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:54.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:54.946841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:55.036296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4f726339-4c21-4d8c-bea1-08f0c55f663a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: .version_select at 0x7f46c0f28c10>, body: {"keypair": {"name": "tempest-keypair-954047321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4MbQSVz+iSu49Nl+YOGqwueldogcrmTEShxnzDPqrM6x1DK9AvP0N6IPubW6Qe6U1XE3v1ixLxmGJKymg0KqowTFoEy+peSGmxXYo4NBo90y6NpxcHfnhiF8aJcfOynQ=="}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:55.055283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-4f726339-4c21-4d8c-bea1-08f0c55f663a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:19:55.061015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-4f726339-4c21-4d8c-bea1-08f0c55f663a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:19:55.092849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:55.101321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-421c17e4-8c6a-497f-9c33-37441a8771d5 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.168045 Sep 13 10:19:55.101883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 293/586] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:54 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:55.138717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4f726339-4c21-4d8c-bea1-08f0c55f663a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106827 Sep 13 10:19:55.139352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 294/587] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:19:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:19:56.124340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:56.127047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:56.127298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:19:56.131926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:56.132412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:56.132878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:56.133582 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:56.134036 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:56.134464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:56.269591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:56.279784 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-68ff98f7-1689-432e-bcb1-d4516f9d5909 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.159487 Sep 13 10:19:56.280360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 294/588] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:56 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:57.303867 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:57.304739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:57.310858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:57.311406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:57.311844 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:57.312543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:57.313003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:57.313441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:57.434125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1248675503", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a50e7ab-833a-427c-9bea-0d826ae0fb4a"}], "security_groups": [{"name": "tempest-securitygroup--181544383"}], "key_name": "tempest-keypair-954047321", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:19:57.454096 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:57.462653 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8edee0f3-f86c-4949-bb42-4dab9864d40e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.163668 Sep 13 10:19:57.465694 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 295/589] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:57 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:57.538080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] validate_networks() for [('3a50e7ab-833a-427c-9bea-0d826ae0fb4a', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:19:57.909067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:19:57.909525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:19:57.910032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:19:57.910442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:19:57.910852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:19:57.920029 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:57.920511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:57.920948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:57.921706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:57.922160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:57.922593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:57.939223 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:19:57.943225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:19:57.955800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:19:57.958088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:19:58.092445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4abb1f3d-362e-4961-902f-08ad94170956 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.662879 Sep 13 10:19:58.093183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 295/590] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:19:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 10:19:58.104589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-be2622ed-7856-45c7-a084-5106b98bf1f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:58.105208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-be2622ed-7856-45c7-a084-5106b98bf1f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:58.158188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-be2622ed-7856-45c7-a084-5106b98bf1f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:58.165097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-be2622ed-7856-45c7-a084-5106b98bf1f9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1241 microversion: 2.1 time: 0.064502 Sep 13 10:19:58.165871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 296/591] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:58 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:19:58.486749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:58.487488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:58.494065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:58.496598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:58.496598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:58.496598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:58.496880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:58.497140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:58.627650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:58.636699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-97905381-eae7-4335-abf2-52650281ee43 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.153528 Sep 13 10:19:58.636699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 296/592] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:58 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:59.188294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:59.188934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:59.196472 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:59.196972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:59.197559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:59.198277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:59.198738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:59.199183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:59.264194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:59.271974 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7e135351-2713-4201-9ac3-d37079b67af2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1237 microversion: 2.1 time: 0.087540 Sep 13 10:19:59.272550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 297/593] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:59 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:19:59.659463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:19:59.660165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:19:59.666658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:59.667142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:59.667649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:59.668329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:19:59.668789 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:19:59.669221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:19:59.797281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:19:59.805417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-63df4b78-87fd-4d18-b169-4da46a1dc6c7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.149841 Sep 13 10:19:59.805976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 297/594] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:19:59 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:00.300478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:00.301137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:00.307486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:00.308030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:00.308455 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:00.309141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:00.309590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:00.310012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:00.384314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:00.396045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e6ce8f9c-1c63-4341-a368-46e2fbdfd42c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1301 microversion: 2.1 time: 0.099330 Sep 13 10:20:00.396630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 298/595] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:00 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:00.829923 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:00.830593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:00.837072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:00.837548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:00.837979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:00.838658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:00.839109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:00.839552 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:00.969349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:00.977443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-724a1690-0724-4f5a-ada0-0ba89994a8d6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.151554 Sep 13 10:20:00.978006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 298/596] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:00 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:01.419637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:01.420311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:01.426779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:01.427308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:01.427750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:01.428437 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:01.428891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:01.429315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:01.489501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:01.497808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0516c954-ffdf-4005-b599-1a0858985c9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1301 microversion: 2.1 time: 0.082584 Sep 13 10:20:01.498380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 299/597] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:01 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:02.000304 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:02.000938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:02.007723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:02.008212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:02.008649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:02.009339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:02.009790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:02.010211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:02.222501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:02.231144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c18c4bf0-a4b9-4154-9cd0-8c9285ef5550 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.234645 Sep 13 10:20:02.231763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 299/598] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:01 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:02.520704 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:02.521388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:02.532696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:02.532696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:02.532696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:02.532696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:02.533313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:02.533313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:02.660945 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:02.669069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f676260c-c0f1-45ce-8ff4-a50f1ee51688 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.152133 Sep 13 10:20:02.680766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 300/599] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:02 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:03.254195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:03.254806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:03.261294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:03.261779 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:03.262228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:03.262929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:03.263406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:03.263829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:03.443199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:03.451446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3bfe9a23-f523-4c36-abe7-b6582c9bb49c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1735 microversion: 2.1 time: 0.201214 Sep 13 10:20:03.452015 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 300/600] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:03 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:03.502001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b", "tag": "81995db5-2ef5-4695-9855-917c764a0b9f"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:03.513866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:03.514484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:03.515085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:03.529910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] Creating event network-changed:81995db5-2ef5-4695-9855-917c764a0b9f for instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b on hv-cinder-85427 Sep 13 10:20:03.534991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-a11b1294-ce02-400e-aa0b-478ab0141354 req-8e8e61d2-649e-4643-a074-2139571706c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036582 Sep 13 10:20:03.535793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 301/601] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:03.692697 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:03.693227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:03.699071 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:03.699574 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:03.700502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:03.701177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:03.701621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:03.702038 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:03.829262 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:03.836883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-66d4132c-40db-44f7-877f-5df3a765ddfa tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.148124 Sep 13 10:20:03.837448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 301/602] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:03 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:04.475698 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:04.476671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:04.483635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.487272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.487272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.487272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.487272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.487701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.611004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:04.619081 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c07f6a8d-5da0-428e-a111-714367300425 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1715 microversion: 2.1 time: 0.148017 Sep 13 10:20:04.619671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 302/603] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:04 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:04.728589 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:04.729070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:04.736103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.736585 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.737020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.737708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.738161 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.738584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.817959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] HTTP exception thrown: Cannot 'detach_volume' instance dcbf82b8-a33f-49ca-940c-951590122eba while it is in vm_state rescued Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Request method failure captured: Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments/be145950-e3ea-43af-bf00-05c984ff459d HTTP/1.1 Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhZW4sQTdUdZZXUi6MiBHiUiD-r5b4inlnbzQ8KrJFEK8yqPkz6ZcETvOIm2ezY487UrNV_r9UGFyYN8iqoug_PkIaC_cfiMkIoPsdJRxHj6fPNe881V3X1jiwdNBz5-gZigcitM4e-YybhYXBdamEb2Dxx0jQZ--YTjFSMkf-OMhc Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:20:04.819595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 1cc3e06e1b1440c18c0fb902beeed27d Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:20:04.820956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Cannot 'detach_volume' instance dcbf82b8-a33f-49ca-940c-951590122eba while it is in vm_state rescued Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'server_id': 'dcbf82b8-a33f-49ca-940c-951590122eba', 'id': 'be145950-e3ea-43af-bf00-05c984ff459d'} Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcbf82b8-a33f-49ca-940c-951590122eba in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:20:04.821677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dcbf82b8-a33f-49ca-940c-951590122eba while it is in vm_state rescued Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dcbf82b8-a33f-49ca-940c-951590122eba while it is in vm_state rescued Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:04.822911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Returning 409 to user: Cannot 'detach_volume' instance dcbf82b8-a33f-49ca-940c-951590122eba while it is in vm_state rescued {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:20:04.823947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b4e05da5-1ece-4076-97d2-470ce1efda7c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments/be145950-e3ea-43af-bf00-05c984ff459d" status: 409 len: 152 microversion: 2.1 time: 0.097435 Sep 13 10:20:04.823947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 302/604] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:20:04 2022] DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments/be145950-e3ea-43af-bf00-05c984ff459d => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 10:20:04.834193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:04.834733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:04.841247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.841739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.842174 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.842880 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.843364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.843796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.861794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:04.862415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:04.868469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.878048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.878048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:04.878048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:04.878048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:04.878638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:05.034138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b03c7cc0-46fc-4e0c-8b94-81f2e48c61d7 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/action" status: 202 len: 0 microversion: 2.1 time: 0.203592 Sep 13 10:20:05.037978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 303/605] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:20:04 2022] POST /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:20:05.043890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:05.044763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:05.051425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:05.051915 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:05.052357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:05.053058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:05.053516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:05.053942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:05.088939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:05.097299 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ea5a5702-731e-4892-af37-277897faccb5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.240140 Sep 13 10:20:05.097867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 303/606] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:04 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:05.294545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:05.302649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b9d7e3d0-5fd8-4db6-8c8a-e422577c64ca tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1723 microversion: 2.1 time: 0.263378 Sep 13 10:20:05.304448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 304/607] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:05 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:06.119699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:06.120310 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:06.127356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:06.127826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:06.128258 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:06.128940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:06.129393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:06.129817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:06.260239 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:06.267929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-81996483-2de8-46fa-9e71-d132c69a2f7b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.152070 Sep 13 10:20:06.268496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 304/608] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:06 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:06.327576 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:06.328218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:06.334626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:06.335111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:06.335586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:06.336269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:06.336722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:06.337147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:06.477572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:06.486967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d2e4af6f-c900-4fae-8d7f-38e14dfcb2e9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1723 microversion: 2.1 time: 0.163217 Sep 13 10:20:06.487564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 305/609] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:06 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:07.291642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:07.292178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:07.298985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:07.299495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:07.299943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:07.300610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:07.301063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:07.301488 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:07.431577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:07.439868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a4803219-a010-4e9d-bfe9-dfe46ffffa27 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.152267 Sep 13 10:20:07.440430 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 305/610] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:07 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:07.509975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:07.510584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:07.517195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:07.517681 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:07.518115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:07.518804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:07.519296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:07.519728 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:07.648177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:07.657140 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5448754b-8bee-4fb9-9846-43ac9463aaa6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1723 microversion: 2.1 time: 0.150970 Sep 13 10:20:07.657707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 306/611] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:07 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:08.462757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:08.463421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:08.465252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:08.465913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:08.471143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:08.477847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:08.477847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:08.477847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:08.477847 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:08.478208 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:08.602139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:08.609626 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-388c085e-2c15-4b76-9ffb-45975efdb736 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.150745 Sep 13 10:20:08.610183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 306/612] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:08 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:08.680887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:08.681490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:08.683489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=6 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:08.689208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:08.689722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:08.690236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:08.690919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:08.691405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:08.691825 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:08.836023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:08.845077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9c8ab086-da7a-40db-8a5b-07e75dc7b1b8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1723 microversion: 2.1 time: 0.168031 Sep 13 10:20:08.849408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 307/613] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:08 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:09.632303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:09.632940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:09.639861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:09.643611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:09.643611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:09.643611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:09.643611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:09.643961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:09.769184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:09.776783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-82e7a6a3-2f87-4619-9919-789887dfa9db tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.148407 Sep 13 10:20:09.777350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 307/614] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:09 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:09.870679 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:09.871834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:09.878162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:09.878647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:09.879108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:09.879826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:09.880308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:09.880734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.013630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:10.021841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e1bc8cbc-73b6-4beb-9ca8-326794c9c29b tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1723 microversion: 2.1 time: 0.155072 Sep 13 10:20:10.022433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 308/615] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:09 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:10.276545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b", "name": "network-vif-plugged", "status": "completed", "tag": "81995db5-2ef5-4695-9855-917c764a0b9f"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:10.286812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.287323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.287796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.290213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:10.298979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] Creating event network-vif-plugged:81995db5-2ef5-4695-9855-917c764a0b9f for instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b on hv-cinder-85427 Sep 13 10:20:10.303995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-f7006f6d-903f-4a19-a277-bc0567568168 req-9b980490-6c53-4d0d-abb6-051b908ce193 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Sep 13 10:20:10.304555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 308/616] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:10.563015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:10.563463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:10.569438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.569925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.570362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.571054 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.571555 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.571984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.604402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4309b91a-3286-4fd8-a735-44a40ee71924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments/b339f8ab-ce3b-4f10-81ed-9607da5b9ab4" status: 200 len: 194 microversion: 2.20 time: 0.045525 Sep 13 10:20:10.605002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 309/617] 10.222.0.62 () {60 vars in 1454 bytes} [Tue Sep 13 10:20:10 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments/b339f8ab-ce3b-4f10-81ed-9607da5b9ab4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:20:10.677987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:10.678589 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:10.685252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.685732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.686167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.686845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.687323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.687750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.767350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lazy-loading 'services' on Instance uuid 43a5958c-f83f-4303-bd83-8078154da9ac {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:20:10.799845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:10.800457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:10.806442 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.806938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.807402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.808089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:10.808538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:10.809454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:10.937032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:10.944933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0a7d33d9-7aaa-4eec-af84-aca383645232 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.148852 Sep 13 10:20:10.945497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 310/618] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:10 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:11.003898 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-274c7617-c5be-4689-92a2-dbfa6c9ec1d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments/b339f8ab-ce3b-4f10-81ed-9607da5b9ab4" status: 202 len: 0 microversion: 2.20 time: 0.330883 Sep 13 10:20:11.004472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 309/619] 10.222.0.62 () {60 vars in 1457 bytes} [Tue Sep 13 10:20:10 2022] DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments/b339f8ab-ce3b-4f10-81ed-9607da5b9ab4 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:20:11.012736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:11.015042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:11.021002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.021478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.021908 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.022590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.023037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.023483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.027026 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:11.045312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:11.047381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:11.052400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.052887 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.053336 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.053668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0c4e5ca1-f3e6-4f52-abef-37290b60b159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Sep 13 10:20:11.054238 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 311/620] 10.222.0.62 () {60 vars in 1343 bytes} [Tue Sep 13 10:20:11 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:20:11.054634 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.055100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.055562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.189728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:11.198058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b6b9f448-7fe3-43fd-aba4-4e21e3c4a983 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1729 microversion: 2.1 time: 0.157628 Sep 13 10:20:11.198619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 310/621] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:11 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:11.221844 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:11.222335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:11.228329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.228818 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.229249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.230156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.231145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.231610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.307677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-549a5514-85d0-4fcb-88b0-661582bd35f6 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090777 Sep 13 10:20:11.308269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 312/622] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:20:11 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:20:11.968859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:11.969471 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:11.976261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.976744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.977179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:11.977875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:11.978329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:11.978757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:12.066817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:12.069013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:12.075781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:12.076271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:12.076717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:12.077420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:12.077880 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:12.078314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:12.108085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-745f6e0b-b2c1-4478-b9db-89d072a3577a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046023 Sep 13 10:20:12.113103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 313/623] 10.222.0.62 () {60 vars in 1343 bytes} [Tue Sep 13 10:20:12 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:20:12.116843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:12.125188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ba9cafd9-6f77-4bc6-868d-d3d5f68145ca tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1366 microversion: 2.1 time: 0.160756 Sep 13 10:20:12.125703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 311/624] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:11 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:12.468731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:12.480773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:12.482531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:12.482977 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:12.501474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] Creating event network-changed:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:20:12.505933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-a954f8f6-2c92-4c81-8a9a-0a16e0b6915b req-f2be7d8a-5148-431f-b70d-e1c16db8fd8d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041508 Sep 13 10:20:12.506541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 314/625] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:13.125525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:13.129088 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:13.139931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.140547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.141083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.142013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.142681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.150133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:13.150782 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.151692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:13.159646 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.160602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.161255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.162187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.162858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.163797 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.210400 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b2633644-87b7-4d5c-a8d8-1139a07142e7 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092495 Sep 13 10:20:13.214694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 312/626] 10.222.0.62 () {60 vars in 1343 bytes} [Tue Sep 13 10:20:13 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:20:13.414947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:13.424097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-babfce0b-920c-445a-84b6-56992cafdf8a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1555 microversion: 2.1 time: 0.279160 Sep 13 10:20:13.424666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 315/627] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:13 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:13.448086 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:13.448780 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:13.454860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.455585 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.456027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.456726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:13.457202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:13.457664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:13.570695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-536ccefc-3c30-49f5-b069-aefced8ada43 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126625 Sep 13 10:20:13.571605 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 313/628] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:20:13 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:14.223025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:14.225172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:14.231743 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.232239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.232683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.233372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.233828 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.234258 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.263435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-89754aea-1132-44a5-b8f4-bf132c3a90d3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044285 Sep 13 10:20:14.264064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 316/629] 10.222.0.62 () {60 vars in 1343 bytes} [Tue Sep 13 10:20:14 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:14.329017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:14.329546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:14.335402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.335872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.336300 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.336974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.337425 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.337837 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.363339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:20:14.522150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:14.531926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.532400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.532829 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.544679 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] Creating event network-changed:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:20:14.549595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-48006299-affa-485a-b7d9-32bb873de643 req-4a0d9aad-6521-44bf-b1c7-1e574d9f0440 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Sep 13 10:20:14.550188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 317/630] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:20:14.658455 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-275b7cfe-b13c-4a92-8814-661b4c817403 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 204 len: 0 microversion: 2.20 time: 0.334039 Sep 13 10:20:14.659270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 314/631] 10.222.0.62 () {60 vars in 1280 bytes} [Tue Sep 13 10:20:14 2022] DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 10:20:14.668136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:14.668840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:14.675091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.675612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.676054 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.676747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.677202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.677631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.849513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b", "tag": "81995db5-2ef5-4695-9855-917c764a0b9f"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:14.860519 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:14.862132 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:14.862132 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:14.874474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] Creating event network-changed:81995db5-2ef5-4695-9855-917c764a0b9f for instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b on hv-cinder-85427 Sep 13 10:20:14.880175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-3fabc3a1-40c6-4f5d-b00d-00d08cc3a7ef req-ab0ceb5e-079a-41c2-ac56-d24e6dc548b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034806 Sep 13 10:20:14.881103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 315/632] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:20:14.922858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:14.931271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:14.933098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:14.935102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1db1430a-4ef4-41fe-b200-a9d3b41a7195 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.271292 Sep 13 10:20:14.935778 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 318/633] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:14 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:15.960767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:15.961461 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:15.968112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:15.968593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:15.969030 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:15.969717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:15.970334 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:15.970600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:16.101407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:16.109365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:16.110799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:16.111983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6caeae1d-72c6-4f7d-a6d3-c6917e99f91e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.155576 Sep 13 10:20:16.112538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 316/634] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:15 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:17.138910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:17.139552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:17.147018 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:17.147633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:17.148133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:17.148904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:17.149429 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:17.149923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:17.379999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:17.396905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:17.398601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:17.401549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3034805f-b0b0-48af-9c4a-5a3b26cbaede tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1724 microversion: 2.20 time: 0.266368 Sep 13 10:20:17.401549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 319/635] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:17 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:17.793689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a5958c-f83f-4303-bd83-8078154da9ac", "name": "network-vif-deleted", "tag": "cddd25b0-cfa5-4390-886e-898790d4d691"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:17.802772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:17.803317 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:17.803698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:17.815396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] Creating event network-vif-deleted:cddd25b0-cfa5-4390-886e-898790d4d691 for instance 43a5958c-f83f-4303-bd83-8078154da9ac on hv-cinder-85427 Sep 13 10:20:17.820317 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-25f3e3e3-010e-4765-b4ff-884c5015c789 req-ec05ea7f-95f9-4c9c-ab08-fa40c1b03798 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Sep 13 10:20:17.820899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 317/636] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:18.426555 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:18.427755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:18.430342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:18.435231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:18.435720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:18.436157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:18.436855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:18.437306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:18.437730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:18.470714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:18.471208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:18.471652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:18.472201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lazy-loading 'fault' on Instance uuid 43a5958c-f83f-4303-bd83-8078154da9ac {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:20:18.515189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:18.523033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:18.524504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:18.525681 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4c2e643a-7c7c-4389-9820-3d67163e18be tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 200 len: 1371 microversion: 2.20 time: 0.103046 Sep 13 10:20:18.526244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 320/637] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:18 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:19.556262 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:19.556954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:19.563652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:19.564133 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:19.564568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:19.565251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:19.565734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:19.566154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:19.578998 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac HTTP/1.1 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:20:19.580665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:20:19.582303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '43a5958c-f83f-4303-bd83-8078154da9ac'} Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:20:19.583201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:20:19.584591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:20:19.585845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:20:19.585845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9b738021-bcd1-4eb1-8ac2-e81c86b3d159 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 404 len: 111 microversion: 2.20 time: 0.030615 Sep 13 10:20:19.585845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 318/638] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:19 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:20:19.590906 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a2a4caf6-2e19-4ce9-aceb-59d777a22e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '.version_select at 0x7f46c0f99b80>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:19.654093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a2a4caf6-2e19-4ce9-aceb-59d777a22e34 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986953892" status: 204 len: 0 microversion: 2.20 time: 0.066956 Sep 13 10:20:19.654578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 321/639] 10.222.0.62 () {60 vars in 1262 bytes} [Tue Sep 13 10:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986953892 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 10:20:20.391957 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aa097f82-3387-40fb-bdc9-d6039e585497 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: .version_select at 0x7f46c10f0ca0>, body: {"keypair": {"name": "tempest-keypair-737946431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjxG90udmSk0jeWyNSCBMv8ZLh8Gh+S8WI5u2hCyCcxLNwplKPgHUVNfThP/52oYurwqtw3gPnezvReCHAoXkk51twQY1cFYRAGFVTlXligpsWnt2Sf3ZMVEzhX22IHDA=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:20.407287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-aa097f82-3387-40fb-bdc9-d6039e585497 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for project b45075d7ec024b3a907d11225942fbee. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:20:20.410969 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-aa097f82-3387-40fb-bdc9-d6039e585497 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for user c069999293a847cdb11650045e22576c and project b45075d7ec024b3a907d11225942fbee. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:20:20.514382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-aa097f82-3387-40fb-bdc9-d6039e585497 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.126189 Sep 13 10:20:20.514894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 319/640] 10.222.0.62 () {62 vars in 1200 bytes} [Tue Sep 13 10:20:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 10:20:22.966435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-906225942", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be664f6-b983-4849-835a-b47b5fa17980"}], "security_groups": [{"name": "tempest-securitygroup--1955704373"}], "key_name": "tempest-keypair-737946431", "user_data": "}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:23.072294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] validate_networks() for [('2be664f6-b983-4849-835a-b47b5fa17980', None, None, None, None, None)] {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:20:23.443821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:20:23.444249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:20:23.444759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:20:23.445174 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:20:23.445596 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:20:23.455184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:23.455676 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:23.459832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:23.459832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:23.459832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:23.459832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:23.474483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for project b45075d7ec024b3a907d11225942fbee. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:20:23.478478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Getting quotas for user c069999293a847cdb11650045e22576c and project b45075d7ec024b3a907d11225942fbee. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:20:23.489427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:20:23.491746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:20:23.628695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bf08cda1-e274-4798-8fb4-b434391a8d98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.667672 Sep 13 10:20:23.629345 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 322/641] 10.222.0.62 () {62 vars in 1188 bytes} [Tue Sep 13 10:20:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 10:20:23.641123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:23.641741 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:23.703548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:23.711840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:23.713412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:23.714414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-872d507c-39de-4e2d-b95c-248599f32912 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1280 microversion: 2.20 time: 0.077824 Sep 13 10:20:23.714961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 320/642] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:23 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:24.739302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:24.739899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:24.745944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:24.746425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:24.746861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:24.747635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:24.748033 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:24.748460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:24.813140 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:24.821715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:24.823185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:24.824984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f47e4c91-b510-4570-a06c-d2535af683f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1284 microversion: 2.20 time: 0.089503 Sep 13 10:20:24.825967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 323/643] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:24 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:25.850544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:25.851183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:25.858325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:25.859813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:25.859813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:25.860093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:25.860554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:25.861045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:25.924618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:25.932874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:25.934325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:25.935478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1f988eba-e645-41da-9d36-e9b5e7201583 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1332 microversion: 2.20 time: 0.089156 Sep 13 10:20:25.936034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 321/644] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:25 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:26.963579 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:26.964306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:26.971271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:26.971766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:26.972234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:26.972949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:26.973406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:26.973835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:27.117212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:27.125302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:27.126757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:27.127932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4b352cb3-bb29-489b-aafa-271d93954e87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.168290 Sep 13 10:20:27.128510 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 324/645] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:26 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:27.854762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:27.860555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:27.865959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:27.866454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:27.867200 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:27.878874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] Creating event network-changed:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:20:27.884160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-feb122e0-dc8e-4fd8-a30b-cf1b4c8dc85d req-5780a9fd-5691-42b9-a64b-c826c1af22f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 Sep 13 10:20:27.884942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 322/646] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:28.153100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:28.153885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:28.160740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:28.161233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:28.161677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:28.162393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:28.162853 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:28.163312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:28.297901 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:28.306328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:28.308546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:28.310306 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f2ea0286-0edb-49a0-94dc-e7058c3efa57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.160908 Sep 13 10:20:28.310872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 325/647] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:28 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:29.335896 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:29.336576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:29.343581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:29.344056 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:29.344484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:29.345160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:29.345603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:29.346018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:29.475318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:29.483361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:29.484937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:29.486050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f94de14a-08b9-4701-95ff-1c4c4bce5f77 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.154387 Sep 13 10:20:29.486610 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 323/648] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:29 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:30.513254 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:30.513882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:30.520282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:30.520758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:30.521184 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:30.521862 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:30.522303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:30.522719 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:30.653159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:30.662036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:30.663531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:30.664645 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3935130c-7eb5-414c-aeda-2b0874a14c8e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.155813 Sep 13 10:20:30.665197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 326/649] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:30 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:31.056367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:31.056905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:31.063997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:31.064486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:31.064932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:31.065625 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:31.066086 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:31.066519 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:31.146115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lazy-loading 'services' on Instance uuid 0d6ac518-daa6-4685-91e9-db203b8dafe4 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:20:31.426221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-40158f83-5a24-4373-9c00-81bb5f5885f8 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments/5479bded-48b3-433d-b683-19c49f8b6491" status: 202 len: 0 microversion: 2.1 time: 0.373630 Sep 13 10:20:31.426886 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 324/650] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:20:31 2022] DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments/5479bded-48b3-433d-b683-19c49f8b6491 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:20:31.689703 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:31.690290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:31.696581 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:31.697066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:31.697507 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:31.698203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:31.698656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:31.699085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:31.826671 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:31.834733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:31.836243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:31.837326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-24298d35-0564-4ea0-9e11-2d3d4434ae8b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.151754 Sep 13 10:20:31.837877 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 327/651] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:31 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:32.864021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:32.864885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:32.870993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:32.871508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:32.871938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:32.872623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:32.873077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:32.874152 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:33.007824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:33.015912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:33.017357 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:33.018456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1d9eede1-5505-4338-a8d8-8e8db4b2ace1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.159801 Sep 13 10:20:33.019010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 325/652] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:32 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:33.610413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:33.612781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:33.613598 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=6 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:33.618317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:33.618800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:33.619264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:33.640942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Going to try to stop instance {{(pid=121003) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 10:20:33.815817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b6d3c44a-b72b-4791-be60-973ccd465763 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action" status: 202 len: 0 microversion: 2.1 time: 0.208964 Sep 13 10:20:33.816419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 328/653] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:20:33 2022] POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:20:33.824569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:33.825182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:33.827797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:33.832651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:33.833135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:33.833567 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:33.834253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:33.834705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:33.835128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:33.963315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:33.970921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-566f9eee-6343-4de6-8c69-23fd42643475 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.150167 Sep 13 10:20:33.971506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 326/654] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:33 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:34.044727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:34.045463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:34.051580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:34.052068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:34.052508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:34.053201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:34.053656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:34.054081 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:34.183582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:34.187754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:34.192654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:34.194114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:34.195255 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-110143d1-2507-4d65-9de8-811f09929500 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.154978 Sep 13 10:20:34.195926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 329/655] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:34 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:34.427914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "name": "network-vif-plugged", "status": "completed", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:34.437916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:34.438398 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:34.438833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:34.449549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] Creating event network-vif-plugged:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:20:34.454296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-0bd013b5-4332-43ae-a9d5-953d9048efad req-8fda0aba-8fd2-4bf4-8988-f7221ff8ef0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030059 Sep 13 10:20:34.454859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 327/656] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:34.994123 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:34.994737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:35.001833 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:35.002356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:35.002791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:35.003513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:35.003966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:35.004433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:35.135066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:35.143230 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4ddc60ce-9ce6-47b9-a813-f1b4c19830a7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.153091 Sep 13 10:20:35.143795 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 330/657] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:34 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:35.222114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:35.222820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:35.229018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:35.229507 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:35.229947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:35.230635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:35.231093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:35.231544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:35.234159 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:35.360560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:35.368487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:35.369904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:35.370997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f781d83a-ffef-4fa7-8520-0ca4975abf7a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.154293 Sep 13 10:20:35.371584 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 328/658] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:35 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:36.167768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:36.168372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:36.175397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:36.175877 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:36.176311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:36.176994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:36.177440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:36.177860 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:36.307271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:36.314887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-20e68c7b-488c-4790-92e9-59d87a7d7069 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.151002 Sep 13 10:20:36.315478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 331/659] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:36 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:36.396171 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:36.396775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:36.403423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:36.403897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:36.404822 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:36.405493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:36.405940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:36.406355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:36.532821 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:36.540807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:36.542246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:36.543387 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e4829a05-8738-4e27-a1b1-2c605f0ce8c3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1406 microversion: 2.20 time: 0.150990 Sep 13 10:20:36.543941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 329/660] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:36 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:37.337784 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:37.338397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:37.344857 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.345342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.345774 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.346460 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.346911 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.347376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.476720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:37.484801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2dfe5095-9726-4ba1-a031-2a8696152cfb tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.151003 Sep 13 10:20:37.485363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 332/661] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:37 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:37.568165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:37.568776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:37.575133 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.575638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.576075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.576755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.577205 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.577629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.704031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:37.712152 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:37.713638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:37.714760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b4c5a04a-df54-4138-9683-39024789bf57 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1598 microversion: 2.20 time: 0.150485 Sep 13 10:20:37.715344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 330/662] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:20:37 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:20:37.740568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:37.741125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:37.747053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.747565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.748005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.748696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:37.749185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:37.749617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:37.824988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2816adba-5936-48dd-b58a-ddd3ffcbf187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088258 Sep 13 10:20:37.825580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 333/663] 10.222.0.62 () {60 vars in 1316 bytes} [Tue Sep 13 10:20:37 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:20:38.507313 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:38.507930 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:38.514429 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:38.514940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:38.515416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:38.516111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:38.516565 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:38.516992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:38.722875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:38.730849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-77a19d7b-9238-4939-82e9-20f73cffe01b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.227388 Sep 13 10:20:38.731640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 331/664] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:38 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:38.886108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:38.895591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:38.896067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:38.896501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:38.908815 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] Creating event network-changed:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:20:38.913729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-f9491b18-e6f2-4650-af77-a2bb1360a643 req-64378427-7e5d-4758-90a1-2be29f8d9610 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032035 Sep 13 10:20:38.914330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 334/665] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:39.759873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:39.760570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:39.767697 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:39.768180 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:39.771604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:39.771604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:39.771604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:39.771604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:40.016893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:40.024569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0b591c11-847d-4f17-a630-a78e9765c957 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.268655 Sep 13 10:20:40.025143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 332/666] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:39 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:41.048557 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:41.049246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:41.056056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:41.056516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:41.056950 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:41.057624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:41.058172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:41.058597 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:41.186636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:41.194328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f6c293e6-f7ee-4d52-9860-df6a3311f74e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.150572 Sep 13 10:20:41.194895 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 335/667] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:41 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:42.216543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:42.217084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:42.223499 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:42.223974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:42.224431 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:42.225109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:42.225560 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:42.225980 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:42.350944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:42.358689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bb250af1-c90a-4f77-a21b-aec8ed59ba13 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.146094 Sep 13 10:20:42.359280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 333/668] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:42 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:43.381906 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:43.382520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:43.389844 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:43.390334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:43.390770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:43.391512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:43.391970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:43.392397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:43.521975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:43.529801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-156c48c9-5bff-4bf8-b84a-170974c0deb5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1676 microversion: 2.1 time: 0.151905 Sep 13 10:20:43.530966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 336/669] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:43 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:44.553384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:44.554005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:44.560487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:44.561484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:44.562010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:44.562608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:44.563082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:44.563521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:44.691998 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:44.699636 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1a15f98a-050f-4c8f-ab9e-2d6b1a7b30d9 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1653 microversion: 2.1 time: 0.150125 Sep 13 10:20:44.700202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 334/670] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:44 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:44.724556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:20:44.728668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:44.729158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:44.729662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:44.752453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Going to try to start instance {{(pid=121003) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 10:20:44.977575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d0396ff8-cc70-4958-9365-82e174784de1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action" status: 202 len: 0 microversion: 2.1 time: 0.259330 Sep 13 10:20:44.978172 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 337/671] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:20:44 2022] POST /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:20:44.986518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:44.987140 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:44.992992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:44.993469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:44.993944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:44.994638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:44.995084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:44.995532 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:45.131407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:45.139804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f796eea0-cec5-41e7-9a49-5667599f854f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1662 microversion: 2.1 time: 0.156637 Sep 13 10:20:45.140378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 335/672] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:44 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:20:46.164574 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:46.165412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:46.172207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:46.172685 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:46.173116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:46.173800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:46.174248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:46.174666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:46.351067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:46.358686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f08ffcba-9da2-48b5-874a-3877300cd084 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1662 microversion: 2.1 time: 0.198922 Sep 13 10:20:46.359274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 338/673] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:46 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:47.381759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:47.382391 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:47.388680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:47.389221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:47.389668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:47.390355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:47.390802 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:47.391242 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:47.519576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:47.527089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2f7483e1-5d77-4a48-9394-1f04f6b7fbda tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1666 microversion: 2.1 time: 0.149210 Sep 13 10:20:47.527932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 336/674] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:47 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:53.771684 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:53.772178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:53.774110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:20:53.778986 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:53.779531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:53.779997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:53.780706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:53.781156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:53.781575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:53.904042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'services' on Instance uuid dcbf82b8-a33f-49ca-940c-951590122eba {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:20:54.150307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-03d6d6d9-5f55-4903-9a75-ad598cc7696e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments/be145950-e3ea-43af-bf00-05c984ff459d" status: 202 len: 0 microversion: 2.1 time: 0.435677 Sep 13 10:20:54.150894 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 339/675] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:20:53 2022] DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments/be145950-e3ea-43af-bf00-05c984ff459d => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:20:54.159821 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:54.166417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:54.171228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:54.171971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:54.172589 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:54.173539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:54.174118 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:54.174651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:54.205145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f7189a13-d758-4ec6-a367-dcd38f7ffdff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049539 Sep 13 10:20:54.205700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 337/676] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:20:54 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:55.218740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:55.221167 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:55.227278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:55.227758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:55.228192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:55.228871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:55.229315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:55.229734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:55.263438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c7e56e65-1d55-4da4-86bc-5ac4b367ca35 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049582 Sep 13 10:20:55.263993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 340/677] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:20:55 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:20:56.276078 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:56.278466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:56.284962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.285436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.285864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.286544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.286988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.287449 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.316337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5bb4715b-7c5a-4851-873f-85bde27e9827 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044322 Sep 13 10:20:56.316970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 338/678] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:20:56 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:20:56.398481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:56.399010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:56.405675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.406162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.406603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.407352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.411922 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.412373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.436748 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:20:56.711705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-abc34a4b-4251-4971-b82d-75db3a7ae5df tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 204 len: 0 microversion: 2.1 time: 0.316707 Sep 13 10:20:56.712216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 341/679] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:20:56 2022] DELETE /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:20:56.720131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:56.724956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:56.726909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.727441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.727880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.728571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:56.729059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:56.729487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:56.857271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:56.865609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bf3202a2-774a-4b61-abbf-f3ba34d31f27 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1689 microversion: 2.1 time: 0.149245 Sep 13 10:20:56.866218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 339/680] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:56 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:57.889988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:57.890684 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:57.897260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:57.897744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:57.898176 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:57.898861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:57.899343 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:57.899767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:58.026595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:58.034589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-677ccd3f-3dc2-4909-a15f-c0e69b1aef92 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1689 microversion: 2.1 time: 0.148996 Sep 13 10:20:58.035150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 342/681] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:57 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:20:59.057730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:20:59.058342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:20:59.065251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:59.065735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:59.066176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:59.066866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:20:59.067355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:20:59.067784 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:20:59.202168 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:20:59.209137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8479f67f-ea3d-4122-87d9-5da347237e5c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1689 microversion: 2.1 time: 0.155190 Sep 13 10:20:59.209706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 340/682] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:20:59 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:00.232394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:00.233010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:00.240097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:00.244079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:00.244079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:00.244079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:00.244079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:00.244494 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:00.368092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:00.375651 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-868e1c80-78b5-4b52-aff5-e394c2d20cd8 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1689 microversion: 2.1 time: 0.147155 Sep 13 10:21:00.376211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 343/683] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:00 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:01.398017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:01.398629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:01.400940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=38 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:01.405844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:01.406328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:01.406768 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:01.407495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:01.407958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:01.408385 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:01.539839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:01.548359 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3edfcb96-4808-4f1d-89e1-3003ed81d2b2 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1689 microversion: 2.1 time: 0.153670 Sep 13 10:21:01.548929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 341/684] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:01 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:01.704251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:01.704930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:01.711116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:01.711637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:01.712075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:01.712781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:01.713241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:01.713697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:01.717569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:01.738981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-875097ae-ac15-4857-a152-95dd96be8ebf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/ips" status: 200 len: 149 microversion: 2.1 time: 0.089198 Sep 13 10:21:01.739606 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 344/685] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:21:01 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:02.245751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbf82b8-a33f-49ca-940c-951590122eba", "name": "network-vif-deleted", "tag": "5e1bece8-e51c-4c59-9ca8-1d3f6d374607"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:02.257247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:02.261928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:02.261928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:02.283927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] Creating event network-vif-deleted:5e1bece8-e51c-4c59-9ca8-1d3f6d374607 for instance dcbf82b8-a33f-49ca-940c-951590122eba on hv-cinder-85427 Sep 13 10:21:02.290139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-e63132a3-e0ac-424e-bf3c-c414c5bc7e8e req-b0fa5dd1-2c3a-4351-b0d6-88454e869a8a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049056 Sep 13 10:21:02.296392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 342/686] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:02.571573 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:02.572347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:02.581154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:02.581775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:02.582323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:02.583376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:02.583878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:02.584395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:02.618376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:02.618962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:02.619427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:02.619875 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'fault' on Instance uuid dcbf82b8-a33f-49ca-940c-951590122eba {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:02.663021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:02.670431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e69ab004-8c67-42cf-9879-200c710d98ff tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 200 len: 1335 microversion: 2.1 time: 0.102731 Sep 13 10:21:02.671012 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 345/687] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:02 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:03.401658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4669ad10-60fc-4f13-a003-55990178cd41"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:03.404367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:03.411532 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:03.411532 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:03.411954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:03.412651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:03.413113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:03.413581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:03.697128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:03.697730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: dcbf82b8-a33f-49ca-940c-951590122eba] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:03.705151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:03.705717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:03.706289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:03.706988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:03.707466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:03.707891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:03.722439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] HTTP exception thrown: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Request method failure captured: Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba HTTP/1.1 Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhZW4sQTdUdZZXUi6MiBHiUiD-r5b4inlnbzQ8KrJFEK8yqPkz6ZcETvOIm2ezY487UrNV_r9UGFyYN8iqoug_PkIaC_cfiMkIoPsdJRxHj6fPNe881V3X1jiwdNBz5-gZigcitM4e-YybhYXBdamEb2Dxx0jQZ--YTjFSMkf-OMhc Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:21:03.724150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 1cc3e06e1b1440c18c0fb902beeed27d Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. Sep 13 10:21:03.730808 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'dcbf82b8-a33f-49ca-940c-951590122eba'} Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:03.732248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. Sep 13 10:21:03.733735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:03.735831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Returning 404 to user: Instance dcbf82b8-a33f-49ca-940c-951590122eba could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:03.735831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1b40b03c-5be5-42b6-b4a8-4dcd1c399527 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba" status: 404 len: 111 microversion: 2.1 time: 0.032717 Sep 13 10:21:03.735831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 346/688] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:03 2022] GET /compute/v2.1/servers/dcbf82b8-a33f-49ca-940c-951590122eba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 10:21:03.738314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ddcf96e4-0a98-44dd-b434-113f32d8042d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '.version_select at 0x7f46c0f00820>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:03.852912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ddcf96e4-0a98-44dd-b434-113f32d8042d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756818781" status: 202 len: 0 microversion: 2.1 time: 0.119493 Sep 13 10:21:03.853412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 347/689] 10.222.0.62 () {58 vars in 1221 bytes} [Tue Sep 13 10:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756818781 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:21:04.175510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6df1c565-4cda-4811-b214-b1536a1d893f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777973 Sep 13 10:21:04.176251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 343/690] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:21:03 2022] POST /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:07.110204 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:07.110699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:07.117656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:07.118195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:07.118666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:07.119397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:07.119850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:07.120272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:07.145608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:21:07.443092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6754add6-c92b-4cb4-93db-1f728f85a46d tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 204 len: 0 microversion: 2.1 time: 0.336474 Sep 13 10:21:07.443885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 348/691] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:21:07 2022] DELETE /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:21:07.453374 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:07.454730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:07.461286 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:07.461769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:07.462208 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:07.462944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:07.463428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:07.463855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:07.467979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:07.595662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:07.603264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d8d4dea8-6c87-4a06-8966-0c7e72540686 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1507 microversion: 2.1 time: 0.154892 Sep 13 10:21:07.603828 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 344/692] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:07 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:08.626716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:08.627440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:08.633850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:08.634337 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:08.634777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:08.635503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:08.635963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:08.636392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:08.770828 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:08.778760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-229a8ee0-9392-4874-b621-86464b2b190e tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1507 microversion: 2.1 time: 0.156320 Sep 13 10:21:08.779354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 349/693] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:08 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:09.802997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:09.803635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:09.810134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:09.810623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:09.811064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:09.811777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:09.812234 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:09.812663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:09.942409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:09.950046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cbe1dce2-3e98-4f5e-b684-6c594251ec17 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1507 microversion: 2.1 time: 0.151064 Sep 13 10:21:09.950607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 345/694] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:09 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:10.972885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:10.973478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:10.979919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:10.980402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:10.980835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:10.981542 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:10.982014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:10.982435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:11.125036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:11.133683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-44524f09-1a02-4636-b7f5-22dfeb48f199 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1507 microversion: 2.1 time: 0.164727 Sep 13 10:21:11.134339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 350/695] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:10 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:11.203132 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6baaa6-306e-4c41-b7db-86c38c8b9859", "name": "network-vif-deleted", "tag": "9875d9fa-823a-4fd4-a5d8-98b0277f8a95"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:11.213367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:11.213842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:11.214269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:11.225569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] Creating event network-vif-deleted:9875d9fa-823a-4fd4-a5d8-98b0277f8a95 for instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 on hv-cinder-85427 Sep 13 10:21:11.230740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-119aff07-f2a0-4558-9720-3d7e8eeb851d req-6ce1a9ec-2e8c-43d2-be9a-24044ebb21bd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100564 Sep 13 10:21:11.231314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 346/696] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:21:12.157023 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:12.157630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:12.164128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.164605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.165029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.165709 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.166186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.166603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.196687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.197061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.197485 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.197917 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'fault' on Instance uuid 9d6baaa6-306e-4c41-b7db-86c38c8b9859 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:12.238280 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:12.246309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-46e7b0ec-9c01-49aa-8633-1d7f4e74f5c4 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 200 len: 1311 microversion: 2.1 time: 0.093199 Sep 13 10:21:12.251319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 351/697] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:12 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:12.776022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4669ad10-60fc-4f13-a003-55990178cd41"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:12.778717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:12.790003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.790491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.790932 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.791654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.792116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.792540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.871451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: POST /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments HTTP/1.1 Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 74 Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:21:12.873212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {"volumeAttachment": {"volumeId": "4669ad10-60fc-4f13-a003-55990178cd41"}} Sep 13 10:21:12.874509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'server_id': '9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b', 'body': {'volumeAttachment': {'volumeId': '4669ad10-60fc-4f13-a003-55990178cd41'}}} Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:12.875343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:12.876569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 400 to user: Invalid volume: volume 4669ad10-60fc-4f13-a003-55990178cd41 is already attached to instances: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f485070f-db92-49cd-b881-7be41746cb9e tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103158 Sep 13 10:21:12.878256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 347/698] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:21:12 2022] POST /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:21:12.941539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:12.942052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:12.948027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.948509 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.948944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:12.949636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:12.950089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:12.950514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.034165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'services' on Instance uuid 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:13.264822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9a1f6930-2064-48ea-8179-740285477003 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments/4669ad10-60fc-4f13-a003-55990178cd41" status: 202 len: 0 microversion: 2.1 time: 0.327009 Sep 13 10:21:13.269566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 352/699] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:21:12 2022] DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments/4669ad10-60fc-4f13-a003-55990178cd41 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:21:13.269715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:13.269715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: 9d6baaa6-306e-4c41-b7db-86c38c8b9859] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:13.275153 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:13.276428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.276921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.277365 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.278025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:13.278322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.278797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.279276 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.284708 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.285220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.285660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.286569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.287022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.287480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.292722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] HTTP exception thrown: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Request method failure captured: Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 HTTP/1.1 Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhZW4sQTdUdZZXUi6MiBHiUiD-r5b4inlnbzQ8KrJFEK8yqPkz6ZcETvOIm2ezY487UrNV_r9UGFyYN8iqoug_PkIaC_cfiMkIoPsdJRxHj6fPNe881V3X1jiwdNBz5-gZigcitM4e-YybhYXBdamEb2Dxx0jQZ--YTjFSMkf-OMhc Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:21:13.294269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 1cc3e06e1b1440c18c0fb902beeed27d Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. Sep 13 10:21:13.295815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '9d6baaa6-306e-4c41-b7db-86c38c8b9859'} Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:13.296684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. Sep 13 10:21:13.298733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:13.299956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Returning 404 to user: Instance 9d6baaa6-306e-4c41-b7db-86c38c8b9859 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:13.299956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-be148e75-ee59-45b2-be0f-ba352fe2803c tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859" status: 404 len: 111 microversion: 2.1 time: 0.031070 Sep 13 10:21:13.299956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 348/700] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:13 2022] GET /compute/v2.1/servers/9d6baaa6-306e-4c41-b7db-86c38c8b9859 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 10:21:13.304536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:13.305036 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:13.311017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.311539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.312121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.313414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.313879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.314309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.318570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8c22a93c-20ff-4e13-b367-311852d299ea tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Sep 13 10:21:13.319137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 353/701] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:13 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:21:13.339637 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:21:13.605110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b21e5f12-9f9f-4177-a3c6-6f10e8f47652 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 204 len: 0 microversion: 2.1 time: 0.303827 Sep 13 10:21:13.605612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 349/702] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:21:13 2022] DELETE /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:21:13.614334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:13.614942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:13.621014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.621501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.621938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.622627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:13.623084 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:13.623536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:13.753943 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:13.761620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-89b28e60-64c0-40fb-aaa7-9a0b9fb33153 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.151144 Sep 13 10:21:13.762180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 354/703] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:13 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:14.336036 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:14.338237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:14.344587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:14.345057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:14.345484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:14.346153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:14.346594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:14.347006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:14.375809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bc06abd6-bf30-4e6a-9b85-2ae09393e01b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Sep 13 10:21:14.376349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 350/704] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:14 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:14.784275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:14.784886 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:14.792499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:14.792988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:14.793429 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:14.794129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:14.794648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:14.795072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:14.922969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:14.930792 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a1842e4b-226c-4214-8c37-8426828957e1 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.150634 Sep 13 10:21:14.931393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 355/705] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:14 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:15.387765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:15.389935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:15.396856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:15.397342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:15.397781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:15.398467 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:15.398924 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:15.399377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:15.428745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-40564617-9aee-4288-b601-77a8cb420f84 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Sep 13 10:21:15.429301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 351/706] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:15 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:21:15.954217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:15.954839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:15.961315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:15.961800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:15.962237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:15.963088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:15.963577 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:15.964007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:16.095601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:16.103193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5955a373-52b1-411b-beb4-1577852f45c9 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.152940 Sep 13 10:21:16.103772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 356/707] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:15 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:16.441735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:16.443880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:16.450154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:16.450627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:16.451058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:16.451752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:16.452204 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:16.452617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:16.481059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c0d0a4ee-32b9-4166-a461-24f16587e1f5 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Sep 13 10:21:16.481600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 352/708] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:16 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:17.126003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:17.126530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:17.133032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:17.133522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:17.133963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:17.134658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:17.135119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:17.135580 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:17.261714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:17.269953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-dfb16207-5c36-481a-a37e-ad21be79b42f tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1521 microversion: 2.1 time: 0.148008 Sep 13 10:21:17.270523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 357/709] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:17 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:17.493298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:17.495528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:17.502257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:17.502741 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:17.503179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:17.503871 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:17.504316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:17.504734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:17.534155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9a0e3d72-c94d-4782-a797-6a474925a609 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Sep 13 10:21:17.534718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 353/710] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:17 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:18.292989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:18.293618 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:18.300950 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.301450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.301894 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.302610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.303068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.303526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.367660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:18.375556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-823abf05-0c32-4406-bed6-f47c88eb1b91 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1479 microversion: 2.1 time: 0.086484 Sep 13 10:21:18.376150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 358/711] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:18 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:18.539018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc04ffd6-17d2-4446-9a30-5bf651dd5a3f", "name": "network-vif-deleted", "tag": "268dff1c-90e0-4ad1-8bc5-f2a35cdb4678"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:18.548720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.549719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.550162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.559721 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:18.561337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] Creating event network-vif-deleted:268dff1c-90e0-4ad1-8bc5-f2a35cdb4678 for instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f on hv-cinder-85427 Sep 13 10:21:18.562125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:18.566799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-f0a0e8fe-6a87-49ee-849c-f4edfafae657 req-abbe2b37-5fee-42b5-ae5f-9de11e4934d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Sep 13 10:21:18.567424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 354/712] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:18.569804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.570374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.570773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.571443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.571898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.572354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.600039 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:18.604573 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2eb716b8-8717-4c0d-b737-08e583c63cec tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048963 Sep 13 10:21:18.605156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 359/713] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:18 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:21:18.680284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:18.680898 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:18.687348 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.687837 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.688298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.693175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:18.693660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:18.694113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:18.720706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:21:19.027750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1a47c118-5e4b-4123-a91a-184f21dbf267 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 204 len: 0 microversion: 2.1 time: 0.351185 Sep 13 10:21:19.028498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 355/714] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:21:18 2022] DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:21:19.037353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:19.037965 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:19.044729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:19.045355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:19.045692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:19.046385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:19.046838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:19.047309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:19.178080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:19.185877 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-262d72f7-0b0e-4a56-a887-9a536cd2878d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1680 microversion: 2.1 time: 0.152993 Sep 13 10:21:19.186455 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 360/715] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:19 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:19.405370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:19.406056 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:19.411960 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:19.412436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:19.412865 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:19.413537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:19.414013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:19.414440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:19.445918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:19.446404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:19.446849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:19.447328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'fault' on Instance uuid cc04ffd6-17d2-4446-9a30-5bf651dd5a3f {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:19.488500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:19.496100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8d390d9a-ec8b-4ede-a1e1-dc13d4833407 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1311 microversion: 2.1 time: 0.095498 Sep 13 10:21:19.496653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 356/716] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:19 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:20.209213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:20.209839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:20.216348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:20.216834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:20.217271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:20.217959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:20.218417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:20.218843 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:20.495537 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:20.503183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-434f2b87-367d-4ee5-8a91-f9a3132175fb tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1680 microversion: 2.1 time: 0.297801 Sep 13 10:21:20.503767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 361/717] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:20 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1680 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:20.521523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:20.522124 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:20.528705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:20.529177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:20.529603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:20.530279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:20.530727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:20.531148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:20.562850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:20.563354 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:20.563781 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:20.564215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lazy-loading 'fault' on Instance uuid cc04ffd6-17d2-4446-9a30-5bf651dd5a3f {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:20.607245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cc3e06e1b1440c18c0fb902beeed27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602cd87d731241e3ad12032e2dd67c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:20.615057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5037adb4-15bc-47af-8e3b-8ea8700dbe57 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 200 len: 1311 microversion: 2.1 time: 0.097812 Sep 13 10:21:20.615637 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 357/718] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:20 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:21.525913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:21.526527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:21.533210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:21.533701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:21.534138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:21.534902 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:21.535380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:21.535807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:21.637843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:21.638527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] [instance: cc04ffd6-17d2-4446-9a30-5bf651dd5a3f] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:21.645677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:21.646165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:21.646644 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:21.648197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:21.648703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:21.649747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:21.664909 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] HTTP exception thrown: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Request method failure captured: Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f HTTP/1.1 Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhZW4sQTdUdZZXUi6MiBHiUiD-r5b4inlnbzQ8KrJFEK8yqPkz6ZcETvOIm2ezY487UrNV_r9UGFyYN8iqoug_PkIaC_cfiMkIoPsdJRxHj6fPNe881V3X1jiwdNBz5-gZigcitM4e-YybhYXBdamEb2Dxx0jQZ--YTjFSMkf-OMhc Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:21:21.666601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/602cd87d731241e3ad12032e2dd67c1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 602cd87d731241e3ad12032e2dd67c1b Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029132022 Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 1cc3e06e1b1440c18c0fb902beeed27d Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029132022-project Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. Sep 13 10:21:21.668121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'cc04ffd6-17d2-4446-9a30-5bf651dd5a3f'} Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:21.668825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. Sep 13 10:21:21.670006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:21.671079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] Returning 404 to user: Instance cc04ffd6-17d2-4446-9a30-5bf651dd5a3f could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:21.671079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-147aad39-a7ae-4788-861a-d42cb1e19ee3 tempest-ServerRescueNegativeTestJSON-1029132022 tempest-ServerRescueNegativeTestJSON-1029132022-project] 10.222.0.62 "GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f" status: 404 len: 111 microversion: 2.1 time: 0.034365 Sep 13 10:21:21.671245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:21.672156 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 358/719] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:21 2022] GET /compute/v2.1/servers/cc04ffd6-17d2-4446-9a30-5bf651dd5a3f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 10:21:21.681333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ce0d8605-6b08-4a12-9903-bc91d191f926 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1680 microversion: 2.1 time: 0.159251 Sep 13 10:21:21.682001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 362/720] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:21 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:22.094635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b", "name": "network-vif-deleted", "tag": "81995db5-2ef5-4695-9855-917c764a0b9f"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:22.106341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:22.106967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:22.107611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:22.119537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] Creating event network-vif-deleted:81995db5-2ef5-4695-9855-917c764a0b9f for instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b on hv-cinder-85427 Sep 13 10:21:22.124422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-8f573a8f-5c97-43e7-a50d-6521a54cb9ec req-0a11be36-7209-4f4d-9088-e4a19f5e286f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Sep 13 10:21:22.125046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 359/721] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:22.704573 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:22.705787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:22.712986 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:22.713866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:22.714636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:22.715546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:22.716159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:22.716811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:22.751857 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:22.752662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:22.753873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:22.754459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'fault' on Instance uuid 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:22.804282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:22.813048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-555682db-bf03-426b-a47a-a6b87dc26ab6 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 200 len: 1331 microversion: 2.1 time: 0.112113 Sep 13 10:21:22.813889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 363/722] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:22 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:23.838552 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:23.840126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:23.846298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:23.847380 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:23.847833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:23.848519 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:23.848974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:23.849427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:23.853502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:23.862912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b HTTP/1.1 Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:21:23.864586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:21:23.866023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b'} Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:23.866892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:21:23.868321 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:23.869645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:23.869645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0ac7ac50-5cdc-4dd1-a3a6-20561a89c6a2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 404 len: 111 microversion: 2.1 time: 0.032220 Sep 13 10:21:23.870119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 360/723] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:23 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:21:23.875192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3f587a7b-cd87-4807-979f-f263a69e1c55 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '.version_select at 0x7f46c10a0a60>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:23.972467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3f587a7b-cd87-4807-979f-f263a69e1c55 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954047321" status: 202 len: 0 microversion: 2.1 time: 0.101118 Sep 13 10:21:23.973049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 364/724] 10.222.0.62 () {58 vars in 1218 bytes} [Tue Sep 13 10:21:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954047321 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 10:21:24.913675 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dc3fefc7-50f2-49fa-bce0-e6a7a42600d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: .version_select at 0x7f46c108f430>, body: {"keypair": {"name": "tempest-keypair-1074476754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQWqmJIeoqeztGT2dlCxYSIaMIhjk6SQlxDY3XlOMMJaTeHHa5HQ6Z4TNoaIKATyck1osOKLcBvwGdSnpGtc62xjq3+NSms5J6u6aUHlb81ruS5Dl0/MOgPc7yXH+JXAw=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:24.938545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-dc3fefc7-50f2-49fa-bce0-e6a7a42600d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:21:24.944026 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-dc3fefc7-50f2-49fa-bce0-e6a7a42600d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:21:25.027013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dc3fefc7-50f2-49fa-bce0-e6a7a42600d0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117674 Sep 13 10:21:25.028095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 361/725] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:21:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:25.870582 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:25.871157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:25.872931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:25.883927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:25.883927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:25.883927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:25.883927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:25.884273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:25.884273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:25.920230 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9d825235-178e-4c61-9232-b59ed1fe2574 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/ips" status: 200 len: 152 microversion: 2.20 time: 0.130223 Sep 13 10:21:25.920638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 365/726] 10.222.0.62 () {60 vars in 1289 bytes} [Tue Sep 13 10:21:25 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/ips => generated 152 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 10:21:27.499068 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1793114220", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a50e7ab-833a-427c-9bea-0d826ae0fb4a"}], "security_groups": [{"name": "tempest-securitygroup--450802305"}], "key_name": "tempest-keypair-1074476754", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:27.618406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] validate_networks() for [('3a50e7ab-833a-427c-9bea-0d826ae0fb4a', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:21:28.096442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:21:28.097506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:21:28.097978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:21:28.098382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:21:28.098790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:21:28.107472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.107951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.108381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:28.109099 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.109548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.109969 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:28.127068 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:21:28.131307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Getting quotas for user 4067d48268f84854af4d672ab3f9dc65 and project 66658bb98ea64e319ed948b8f279ed5f. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:21:28.142614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:21:28.145525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:21:28.296308 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-099c2855-462b-4b47-bb13-6eb3077b932c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.802632 Sep 13 10:21:28.297004 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 362/727] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:21:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:21:28.308257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ac3609e4-3836-4667-be75-21d8a5efd62a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:28.309022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ac3609e4-3836-4667-be75-21d8a5efd62a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:28.371930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ac3609e4-3836-4667-be75-21d8a5efd62a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:28.376185 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ac3609e4-3836-4667-be75-21d8a5efd62a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1242 microversion: 2.1 time: 0.071771 Sep 13 10:21:28.377093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 366/728] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:28 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:28.452749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:28.453603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:28.463014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.463014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.463014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:28.463014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.463641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.464233 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:28.488890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lazy-loading 'flavor' on Instance uuid a9a6c608-489a-41f5-b4ff-8c2a248af808 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:28.955583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5f356903-6768-4059-984c-61e5ea30c9f9 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/action" status: 202 len: 0 microversion: 2.20 time: 0.506557 Sep 13 10:21:28.956277 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 363/729] 10.222.0.62 () {62 vars in 1319 bytes} [Tue Sep 13 10:21:28 2022] POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:21:28.965979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:28.972881 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:28.973688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.974224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.974631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:28.975369 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:28.975831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:28.976399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:29.109423 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:29.118446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:29.119937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:29.121126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b74a9390-6f72-4dcd-95d1-f109f3572b60 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.160533 Sep 13 10:21:29.121693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 367/730] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:28 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:29.399344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:29.400056 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:29.406490 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:29.406971 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:29.407430 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:29.408114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:29.408567 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:29.409480 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:29.473515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:29.481357 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-baba8f0f-4a42-46a6-99dd-90cad02268ac tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1246 microversion: 2.1 time: 0.086253 Sep 13 10:21:29.481916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 364/731] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:29 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:30.147933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:30.148588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:30.155233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:30.155678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:30.156120 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:30.156858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:30.157321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:30.157752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:30.301657 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:30.309819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:30.311300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:30.312546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c8d9fe77-238b-482d-9c09-8eaef63a3950 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.169108 Sep 13 10:21:30.313099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 368/732] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:30 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:30.505230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:30.505835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:30.512150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:30.512628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:30.513059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:30.513745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:30.514201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:30.514618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:30.578839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:30.586590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-71602ce5-7c6c-4141-b0cf-f5207e71e410 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1302 microversion: 2.1 time: 0.085814 Sep 13 10:21:30.587155 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 365/733] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:30 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:31.340063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:31.340611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:31.347640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:31.348125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:31.348561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:31.349251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:31.349697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:31.350249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:31.500860 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:31.509885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:31.511384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:31.512568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-77c55bea-0467-4bfa-8663-728dbaaed779 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.176558 Sep 13 10:21:31.513444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 369/734] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:31 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:31.610081 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:31.611952 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:31.619097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:31.621256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:31.622067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:31.622958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:31.623870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:31.624487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:31.625110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:31.810642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:31.822801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-edec3108-1bd9-40e4-86ae-0e3ddf2493d9 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.218029 Sep 13 10:21:31.843895 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 366/735] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:31 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:32.492604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75681e9a-70e7-4876-a644-7da412c384c5", "tag": "e14a2cd2-7a70-4bcf-b52e-0b0e708566c7"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:32.504558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:32.505054 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:32.505491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:32.519236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] Creating event network-changed:e14a2cd2-7a70-4bcf-b52e-0b0e708566c7 for instance 75681e9a-70e7-4876-a644-7da412c384c5 on hv-cinder-85427 Sep 13 10:21:32.522338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-1dde55d7-84c2-4345-8f8f-133b915f6869 req-20a51c62-8fb8-4114-9bac-dc58a775957c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Sep 13 10:21:32.522939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 370/736] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:32.545254 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:32.546526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:32.553894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:32.554792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:32.555648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:32.556691 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:32.557345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:32.558494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:32.699693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:32.709421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:32.710851 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:32.712041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d2d1489c-9de3-4224-b6d8-4d73db6e2924 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.176587 Sep 13 10:21:32.712594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 367/737] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:32 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:32.853213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:32.853985 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:32.860632 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:32.861121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:32.861542 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:32.862286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:32.862735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:32.863181 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:32.999064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:33.012090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c534685d-b038-4e05-b01e-1950fd3b12f1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.163167 Sep 13 10:21:33.012090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 371/738] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:32 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:33.738112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:33.738752 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:33.745482 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:33.745965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:33.746409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:33.747100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:33.747607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:33.748032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:33.883227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:33.891522 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:33.893722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:33.894924 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-193407c6-65bb-4184-8f72-e0b3f8832f92 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.161009 Sep 13 10:21:33.895508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 368/739] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:33 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:34.033940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:34.034553 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:34.041100 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:34.041587 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:34.042017 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:34.042708 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:34.043183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:34.043609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:34.175350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:34.182930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-30a93961-2e2a-4c88-aeaa-b961aa254d7c tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.152802 Sep 13 10:21:34.183737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 372/740] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:34 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:34.921331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:34.921946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:34.928392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:34.928877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:34.929314 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:34.929999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:34.930457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:34.930880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.057892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:35.066000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:35.067471 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:35.068711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fbb8b490-90c5-4fe6-b03b-1f5f545933ff tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.151334 Sep 13 10:21:35.069265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 369/741] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:34 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:35.144765 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:35.146863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:35.153441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.153928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.154366 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.155050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.155529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.155953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.183589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-56c37d80-2774-4b7f-b851-3d433b394136 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043499 Sep 13 10:21:35.184177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 373/742] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:21:35 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:21:35.206261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:35.206864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:35.212733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.217719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.217719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.217719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.217719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.218186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.248467 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:35.248962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:35.255545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.256028 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.256462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.257155 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.257624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.258029 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.283682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:21:35.347711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:35.355395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fb09f26c-e3a5-430c-9988-a81006d91aee tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.153477 Sep 13 10:21:35.355960 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 370/743] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:35 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:35.559531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3059a24b-89e4-40a1-923a-ae774f749498 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 204 len: 0 microversion: 2.1 time: 0.314693 Sep 13 10:21:35.560356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 374/744] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:21:35 2022] DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:21:35.569009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:35.569632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:35.575651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.576159 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.576676 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.577379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:35.577837 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:35.578263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:35.712833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:35.720644 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-97d380e6-6514-4bda-aa92-041fddf26f00 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1672 microversion: 2.1 time: 0.155971 Sep 13 10:21:35.721235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 371/745] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:35 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:36.095278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:36.095902 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:36.102401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.102912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.103372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.104064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.104513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.104997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.239736 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:36.247970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:36.249422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:36.250641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-03c4b5e4-313d-4c4d-8d15-63868bac3681 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.159747 Sep 13 10:21:36.251227 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 375/746] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:36 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:36.378021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:36.378553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:36.385031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.385551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.385989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.386695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.387153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.387607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.516083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:36.524145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9475df71-cf5b-46b0-b06f-288634502cc1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.150029 Sep 13 10:21:36.524714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 372/747] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:36 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:36.746707 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:36.748329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:36.754838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.755361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.755825 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.756527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:36.756985 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:36.757419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:36.889242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:36.898973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5fe2d48e-7662-4bbe-85f3-41db607c4a46 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1672 microversion: 2.1 time: 0.156544 Sep 13 10:21:36.899575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 376/748] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:36 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:37.277868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:37.278512 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:37.284465 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.284954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.288502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:37.288502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.288502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.288502 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:37.418900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:37.427989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:37.429512 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:37.430791 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9cb46e29-fe80-42b0-8686-0df678a2f94c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.157290 Sep 13 10:21:37.431454 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 373/749] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:37 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:37.547565 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:37.548175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:37.555623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.556101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.556533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:37.557258 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.557712 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.558136 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:37.576850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:37.691101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:37.698623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4bf79431-489f-4493-b125-819fedac9f83 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.154945 Sep 13 10:21:37.699224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 377/750] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:37 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:37.922801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:37.923732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:37.930917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.931456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.932243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:37.933127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:37.933723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:37.934146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.066858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:38.074816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-72b62734-d32a-4f59-80c3-603c0b742c3a tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1672 microversion: 2.1 time: 0.155853 Sep 13 10:21:38.075418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 374/751] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:37 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:38.444704 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6ac518-daa6-4685-91e9-db203b8dafe4", "name": "network-vif-deleted", "tag": "29f0b49b-c442-4029-ab17-b8c8e27031dc"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:38.449861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:38.456507 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:38.456980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:38.457409 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.458259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:38.458880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:38.460763 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:38.461856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=10 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:38.467475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:38.468113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:38.468559 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.468869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] Creating event network-vif-deleted:29f0b49b-c442-4029-ab17-b8c8e27031dc for instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 on hv-cinder-85427 Sep 13 10:21:38.469267 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:38.469728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:38.470167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.473783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-131161aa-d352-4345-88fd-a9789af58fc2 req-b8367c62-8486-46d9-9e3e-f1e919119c62 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Sep 13 10:21:38.474439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 378/752] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:38.634330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:38.644764 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:38.646201 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:38.647436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6191b7d6-02de-4114-b4c2-ff99be722997 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.193818 Sep 13 10:21:38.648039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 375/753] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:38 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:38.725040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:38.725735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:38.732058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:38.732730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:38.733168 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.733885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:38.734333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:38.734752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:38.876623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:38.885406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-78e4f922-24fd-44ba-a632-996bb1251355 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.166663 Sep 13 10:21:38.886374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 379/754] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:38 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:39.081082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75681e9a-70e7-4876-a644-7da412c384c5", "name": "network-vif-plugged", "status": "completed", "tag": "e14a2cd2-7a70-4bcf-b52e-0b0e708566c7"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:39.090535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.091136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.091856 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.099234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:39.100117 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:39.106744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.107386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.109260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.112217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.112217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.112217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.112940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] Creating event network-vif-plugged:e14a2cd2-7a70-4bcf-b52e-0b0e708566c7 for instance 75681e9a-70e7-4876-a644-7da412c384c5 on hv-cinder-85427 Sep 13 10:21:39.118129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-5d0c125b-6357-4f5a-be68-64eeaa6465b5 req-360d565d-630e-442e-8a8f-434c5d8743fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202299 Sep 13 10:21:39.119047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 376/755] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:39.145229 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.145863 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.146376 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.146930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lazy-loading 'fault' on Instance uuid 0d6ac518-daa6-4685-91e9-db203b8dafe4 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:39.190761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:39.198691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c3c05776-0ea1-41c8-a006-b7f2688c279b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 200 len: 1327 microversion: 2.1 time: 0.103930 Sep 13 10:21:39.199288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 380/756] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:39 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:39.686654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:39.687379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:39.694740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.695436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.696022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.696887 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.697805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.698381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.836873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:39.838068 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:39.845144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:39.847229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:39.848378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b9ce8490-ecfd-4fee-a6b3-24303c444e95 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.167348 Sep 13 10:21:39.848947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 377/757] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:39 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:39.914210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:39.914811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:39.921398 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.921871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.922319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:39.923000 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:39.923473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:39.923957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:40.059312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:40.066979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4c70fcab-0367-4b4b-a8c4-5949885aa8d2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.156708 Sep 13 10:21:40.067583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 381/758] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:39 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:40.222670 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:40.223285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:40.229901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:40.230393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:40.230931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:40.231606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:40.232064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:40.232495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:40.245842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 HTTP/1.1 Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:21:40.247578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:21:40.249212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '0d6ac518-daa6-4685-91e9-db203b8dafe4'} Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:40.250150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:21:40.251531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:21:40.252690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:40.252690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-38612744-2845-4576-a6b8-f642dc651def tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 404 len: 111 microversion: 2.1 time: 0.030897 Sep 13 10:21:40.252690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 378/759] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:40 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:21:40.258025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87abaed7-bae2-44f3-8c29-199fefd3c8fa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '.version_select at 0x7f46c13e1280>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:40.339812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87abaed7-bae2-44f3-8c29-199fefd3c8fa tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943774531" status: 202 len: 0 microversion: 2.1 time: 0.085645 Sep 13 10:21:40.340408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 382/760] 10.222.0.62 () {58 vars in 1218 bytes} [Tue Sep 13 10:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943774531 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:21:40.874353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:40.874972 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:40.883760 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:40.887498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:40.888193 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:40.889264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:40.890114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:40.893009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:41.036539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:41.043924 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:41.045373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:41.046537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-761ddfc3-96da-4568-9243-b4aebfacafe5 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.176154 Sep 13 10:21:41.047100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 379/761] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:40 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:41.092371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:41.093047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:41.099217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:41.099722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:41.100149 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:41.100850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:41.101305 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:41.101731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:41.235421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:41.246103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c654b573-288c-41b6-a22c-06f25aa8cc91 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1367 microversion: 2.1 time: 0.157527 Sep 13 10:21:41.259871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 383/762] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:41 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:41.347356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-842e672c-13ae-43b3-82b5-1cceb77f5420 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: .version_select at 0x7f46c101b940>, body: {"keypair": {"name": "tempest-keypair-204844795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfsUGRilg0aXqEXwOfCp+oLiMHatjzowchBfXbx3ztB8Jxw2g636OqsBEvIjrHn5eSLDJjbtplIgkSyLEB3rs00bDqn+VUW5FeOao4RW2E6r3x41kZYPtHRG9PefZLDw=="}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:41.363991 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-842e672c-13ae-43b3-82b5-1cceb77f5420 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for project c9aaa16702a5422b90578033420da9bd. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:21:41.367910 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-842e672c-13ae-43b3-82b5-1cceb77f5420 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for user 90f07b101240464387f3fbf92c925ec7 and project c9aaa16702a5422b90578033420da9bd. Resources: {'key_pairs'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:21:41.457642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-842e672c-13ae-43b3-82b5-1cceb77f5420 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115060 Sep 13 10:21:41.458181 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 380/763] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:21:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:42.080929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:42.080929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:42.083523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.084007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.084473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.085187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.085639 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.086062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.222949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:42.231314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:42.232785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:42.234130 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f307eafc-21cc-49a8-892c-0ad2f8a87d16 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.164074 Sep 13 10:21:42.234683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 384/764] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:42 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:42.270188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:42.270829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:42.276713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.277439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.277878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.278548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.278994 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.279439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.431690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:42.440602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6b859134-47e3-413e-8b81-3023f1cda3c2 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1557 microversion: 2.1 time: 0.174178 Sep 13 10:21:42.441172 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 381/765] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:42 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:42.467563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:42.468126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:42.474824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.475578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.476024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.476897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:42.477405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:42.477826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:42.561307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87771625-55b4-40ad-bbca-63dc2a5141ed tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097944 Sep 13 10:21:42.562032 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 385/766] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:21:42 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:43.260923 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:43.261537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:43.274718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:43.275539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:43.275629 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:43.276283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:43.276748 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:43.277426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:43.508412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:43.516603 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:43.518676 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:43.519868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-421b3a08-6667-4d22-b15c-1a37c01b0c78 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.262828 Sep 13 10:21:43.520421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 382/767] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:43 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:43.740595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75681e9a-70e7-4876-a644-7da412c384c5", "tag": "e14a2cd2-7a70-4bcf-b52e-0b0e708566c7"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:43.751685 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:43.752799 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:43.753317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:43.765576 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] Creating event network-changed:e14a2cd2-7a70-4bcf-b52e-0b0e708566c7 for instance 75681e9a-70e7-4876-a644-7da412c384c5 on hv-cinder-85427 Sep 13 10:21:43.770898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-77c63c14-c5af-424e-b3f2-5d93f622b0bb req-f908596b-4924-4b96-aad3-a86bfdc1289f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098896 Sep 13 10:21:43.772052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 386/768] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:43.823252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1087746871", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebff5e7b-2242-4a30-a2b5-9e7b0fe34011"}], "security_groups": [{"name": "tempest-securitygroup--2085623098"}], "key_name": "tempest-keypair-204844795", "user_data": "}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:43.942630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] validate_networks() for [('ebff5e7b-2242-4a30-a2b5-9e7b0fe34011', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:21:44.376748 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:21:44.377381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:21:44.377656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:21:44.378060 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:21:44.378515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:21:44.388436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:44.389154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:44.389743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:44.390759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:44.391428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:44.395979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:44.410393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for project c9aaa16702a5422b90578033420da9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:21:44.414708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Getting quotas for user 90f07b101240464387f3fbf92c925ec7 and project c9aaa16702a5422b90578033420da9bd. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:21:44.427341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:21:44.429407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:21:44.541084 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e0d37fb4-536a-40e2-8a4d-44852d9824d3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722467 Sep 13 10:21:44.542106 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 383/769] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:21:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:21:44.554744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:44.555437 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-89f027de-bd0a-4e0a-91b7-6044f26b543e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:44.560600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:44.560751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-89f027de-bd0a-4e0a-91b7-6044f26b543e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:44.563505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:44.564189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:44.564865 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:44.566720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:44.567927 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:44.569041 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:44.672474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-89f027de-bd0a-4e0a-91b7-6044f26b543e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:44.699505 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-89f027de-bd0a-4e0a-91b7-6044f26b543e tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1237 microversion: 2.1 time: 0.149181 Sep 13 10:21:44.700102 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 384/770] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:44 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1237 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:44.803702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:44.814322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:44.816510 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:44.817717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ba9b82d3-281d-4ca5-80d8-127000c228ad tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.267666 Sep 13 10:21:44.818268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 387/771] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:44 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:45.726957 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:45.727593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:45.734074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:45.734571 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:45.735008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:45.735735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:45.736306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:45.736679 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:45.797363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:45.805178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-96c9b6ea-6542-44a7-a54d-f5df9374b9b1 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1241 microversion: 2.1 time: 0.082109 Sep 13 10:21:45.805702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 385/772] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:45 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:45.843824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:45.844433 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:45.851047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:45.855543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:45.855543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:45.855543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:45.855543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:45.856022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:45.993970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:46.003025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:46.004549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:46.005729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0a6f90b7-3934-4a78-9a66-7575f8a8caa4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1744 microversion: 2.20 time: 0.165771 Sep 13 10:21:46.006293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 388/773] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:45 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:46.831319 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:46.831922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:46.844343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:46.844836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:46.845269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:46.846608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:46.847083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:46.847529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:46.928550 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:46.940575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bdccb0b1-24e5-4e94-8b91-07b8ad60ca19 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1289 microversion: 2.1 time: 0.115738 Sep 13 10:21:46.942295 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 386/774] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:46 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:47.036261 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:47.037731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:47.049649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.050182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.050628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.054883 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.055406 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.057721 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.228967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:47.237308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:47.238795 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:47.240278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-53c83ec5-18d3-4697-b95f-099188897b5f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.209852 Sep 13 10:21:47.241166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 389/775] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:47 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:47.525128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:47.526492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:47.535284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.535943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.536974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.538362 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.539100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.539820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.569087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:21:47.890116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f51f8cf3-6442-4863-99aa-63b30c903603 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 204 len: 0 microversion: 2.1 time: 0.371969 Sep 13 10:21:47.896114 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 387/776] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:21:47 2022] DELETE /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:21:47.900391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:47.901013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:47.909017 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.909517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.909956 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.910710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.911121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.911624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.966268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:47.967396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:47.977563 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.978355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.983787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:47.983787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:47.983787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:47.983787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:48.121291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:48.132201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-31011ba7-40da-41a7-a00b-01ca97519318 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1576 microversion: 2.1 time: 0.235746 Sep 13 10:21:48.132778 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 390/777] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:47 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:48.195196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:48.202967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7396aed9-2938-4d99-baf6-311e25c6686b tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.241228 Sep 13 10:21:48.203689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 388/778] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:47 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:48.269067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:48.269924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:48.276612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:48.277464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:48.277987 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:48.278761 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:48.279328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:48.279821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:48.429894 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:48.440355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:48.442265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:48.443766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4e74addf-59e5-4815-8862-e162757af606 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.179118 Sep 13 10:21:48.444596 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 391/779] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:48 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:48.706864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "name": "network-vif-plugged", "status": "completed", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:48.725472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:48.725985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:48.726415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:48.742863 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] Creating event network-vif-plugged:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:21:48.748715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-8eff86a4-35b9-4ac0-9357-1b29b6c9a7aa req-f396da01-c107-4641-bf60-bbef5b030577 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045623 Sep 13 10:21:48.750470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 389/780] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:49.157295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:49.158998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:49.171514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.172411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.173193 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.174905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.175643 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.176352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.232005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:49.234041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:49.242935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.247772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.247772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.247772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.247772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.248153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.525713 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:49.537088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-415795f3-022a-4d67-bff0-a36298cdbcfe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1576 microversion: 2.1 time: 0.384183 Sep 13 10:21:49.537675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 392/781] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:49 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1576 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:49.552394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:49.553225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:49.572722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.572865 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:49.572970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.572970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.572970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:49.572970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:49.573365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:49.577648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b321bfe5-8fb0-4ecf-8f1a-36afc910cf66 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.355435 Sep 13 10:21:49.578755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 390/782] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:49 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:49.991546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d9caab-c36d-43c3-b09a-362716549fce", "tag": "6a9e22f8-803d-4cec-b60d-b75dbadaf04e"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:50.006815 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:50.010432 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:50.011074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:50.026630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] Creating event network-changed:6a9e22f8-803d-4cec-b60d-b75dbadaf04e for instance a6d9caab-c36d-43c3-b09a-362716549fce on hv-cinder-85427 Sep 13 10:21:50.037111 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-306bf866-6911-4fee-a76c-da3e46e3ec8f req-7e91046c-a220-40b6-a24a-dd370a1ec731 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046979 Sep 13 10:21:50.038322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 391/783] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:50.123052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:50.132330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:50.133724 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:50.140807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c83179c5-43e9-4438-b74d-716ef8b75267 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.592331 Sep 13 10:21:50.141393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 393/784] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:49 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:50.562473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:50.563229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:50.573522 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:50.574597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:50.575428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:50.576557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:50.577264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:50.578976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:50.605921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:50.606538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:50.619568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:50.620167 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:50.623972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:50.624939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:50.625617 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:50.626139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:50.976633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:50.991018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0209e130-63c0-4c67-b3fb-7b9ca156706f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1576 microversion: 2.1 time: 0.433352 Sep 13 10:21:51.006457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 392/785] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:50 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1576 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:51.065049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:51.080203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1fcd836c-79ce-4d5f-8a9d-74e263445239 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.479944 Sep 13 10:21:51.084471 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 394/786] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:50 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:51.173874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:51.175075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:51.183960 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:51.184695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:51.185282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:51.186179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:51.186682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:51.187121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:51.400112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:51.411322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:51.413503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:51.414955 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-69605677-a9e9-4833-b65b-9fff50a81598 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.248348 Sep 13 10:21:51.427280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 393/787] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:51 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:51.562066 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3", "name": "network-vif-deleted", "tag": "6cb2c144-20ad-4b64-bae8-d285863ef58e"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:51.573391 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:51.573888 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:51.574320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:51.587557 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] Creating event network-vif-deleted:6cb2c144-20ad-4b64-bae8-d285863ef58e for instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 on hv-cinder-85427 Sep 13 10:21:51.592972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-23984003-12f0-43f0-a06d-b2d9103b4df9 req-e75196b7-8b2d-4e93-b8fc-f992d35bef6f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Sep 13 10:21:51.593660 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 395/788] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:52.022282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:52.024047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:52.035485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.036459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.037614 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.039601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.040627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.046246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.121774 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:52.122803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:52.138295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.142788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.142788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.142788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.142788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.143188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.211982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:52.225195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-caefe1fc-7053-4956-8127-967cf015de80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1508 microversion: 2.1 time: 0.208322 Sep 13 10:21:52.244879 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 394/789] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:52 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:52.445245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:52.446062 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:52.456443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.465441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.466247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.468302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:52.470841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:52.471541 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:52.505495 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:52.519293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9fecc30e-6f4a-44a7-9f77-5ce71b420635 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.411455 Sep 13 10:21:52.520280 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 396/790] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:52 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:52.777492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:52.792436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:52.795561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:52.802446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f6d71ee9-37da-4bdf-b4ce-79ec91ddbe5b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.363795 Sep 13 10:21:52.809254 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 395/791] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:52 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:53.253446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:53.254714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:53.261803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.262265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.262710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.263446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.264081 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.264699 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.269525 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:53.309962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.310456 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.311079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.311757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lazy-loading 'fault' on Instance uuid 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:53.401607 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:53.411884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ae95f18a-eca9-4db7-a43a-4ca379e6a0bb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 200 len: 1229 microversion: 2.1 time: 0.163217 Sep 13 10:21:53.428002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 397/792] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:53 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 1229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:53.545134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:53.546582 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:53.554925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.556047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.556988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.558075 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.558738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.559421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.716832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:53.728336 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4b3e4401-c693-4da5-9ef1-3b25cd690c16 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.188102 Sep 13 10:21:53.729130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 396/793] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:53 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:53.834678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:53.835706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:53.841930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.842844 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.843404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:53.844238 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:53.846071 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:53.847209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.021483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:54.034030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:54.035745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:54.037202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2138b4a7-b5d4-4936-aee5-16880fdac7b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.207200 Sep 13 10:21:54.051547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 398/794] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:53 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:54.269805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:54.270848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:54.284343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.285183 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.286415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.287331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.290451 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.295149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.329542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:54.368608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lazy-loading 'flavor' on Instance uuid c5e3aa48-e46d-4063-bec2-139465c7b571 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:21:54.402623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:54.439816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:54.441052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:54.448917 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.450763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.451755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.458079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.458079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.458079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.468474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] HTTP exception thrown: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Request method failure captured: Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 HTTP/1.1 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFjTdvlu7ezD-t4fwu8HsgJR-A0ccTknqfNhW2EWI6YF-aOuCoG_JIvvDtRlIEFJE2ab2qwib6DZOszmh5Og-ZNop2uRjCk7QDHCEzDTS983NnmQnZ-cTd46suzaUofepsKD1ocOvc_XwANVugA0pbGwxUeH4H2fKPt2_jcyyNwww_Y Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:21:54.470062 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7cc199dd87e24511a8d267603b571456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7cc199dd87e24511a8d267603b571456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-TestVolumeBootPattern-485337623 Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 7ddb2572cac446aa92a0bcf170d9e8d6 Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:21:54.472418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3'} Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:21:54.473237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:21:54.474452 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:21:54.477275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Returning 404 to user: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:21:54.477275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c9bf12e7-cc22-4591-8128-c2e15817f60f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 404 len: 111 microversion: 2.1 time: 0.037409 Sep 13 10:21:54.484254 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 399/795] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:54 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:21:54.604145 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1060937193", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-869991838", "security_groups": [{"name": "tempest-secgroup-smoke-1867770006"}], "block_device_mapping_v2": [{"uuid": "58b77162-3d7c-41c9-8de8-7dae5a57cac5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "efbc911f-ad2a-4c68-952b-f6a00ba8476f"}]}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:54.679836 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=12 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:54.690082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-60ddc563-04d8-4851-9a09-19f8b00d2052 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "POST /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571/action" status: 202 len: 0 microversion: 2.1 time: 0.428110 Sep 13 10:21:54.691202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 397/796] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:21:54 2022] POST /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:21:54.702329 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:54.703723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:54.713656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.713656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.713656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.714346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:54.715090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:54.715721 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:54.795862 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.network.neutron [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] validate_networks() for [('efbc911f-ad2a-4c68-952b-f6a00ba8476f', None, None, None, None, None)] {{(pid=121003) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:21:55.074900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:55.083580 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-36e02ef9-608c-492b-b657-91dd95bae662 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.385319 Sep 13 10:21:55.087345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 398/797] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:54 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:55.107519 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:55.108353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:55.115859 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:55.117842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.119270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.120297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.121798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.122486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.123888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.358553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:55.379195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a22032da-da76-4a31-960c-9d46f17848ab tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.278022 Sep 13 10:21:55.379195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 399/798] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:55 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:55.379195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:55.381404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:55.393939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.395658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.397743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.398545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.399751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.406798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.597222 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:21:55.597726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image limits 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:21:55.598108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:21:55.598889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image pref 0:0:0 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:21:55.599606 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.virt.hardware [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121003) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:21:55.611670 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.612419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.613214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.614112 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:55.614725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:55.615356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:55.629941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:55.641672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:21:55.646801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for user 7ddb2572cac446aa92a0bcf170d9e8d6 and project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:21:55.647151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:55.649054 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:55.650331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9d4134c9-6301-49a0-912f-aeae2dd16abb tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.282187 Sep 13 10:21:55.651117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 400/799] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:55 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:55.727678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Going to run 1 instances... {{(pid=121003) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:21:55.729912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58b77162-3d7c-41c9-8de8-7dae5a57cac5',volume_size=None,volume_type=None)] {{(pid=121003) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:21:56.106976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:56.107577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:56.113941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.114148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.114589 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.115319 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.116539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.116539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.285097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:56.300601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b3b750cb-cae2-4362-9842-c98274f49b5f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.193206 Sep 13 10:21:56.300601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 401/800] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:56 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:56.320613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:21:56.399513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:56.400459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:56.407157 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.408433 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.408858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.409715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.410184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.410682 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.579370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:56.588875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c4fb947f-1383-4f48-8398-fd8055050e2f tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.198385 Sep 13 10:21:56.589694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 402/801] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:56 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:56.678965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:56.679521 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:56.685681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.686165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.686600 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.687469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:56.688397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:56.690377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:56.859611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a3b3c0fc-5a9a-4b3e-91a4-c5ce3ac7f97f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.261055 Sep 13 10:21:56.864385 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:56.867547 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 400/802] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:21:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:21:56.872873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7ae94723-363a-4fc5-82df-5eb213c547cd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:56.875006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7ae94723-363a-4fc5-82df-5eb213c547cd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:56.891946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:56.916838 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:56.918093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dec695ed-315d-4435-8a56-367070eab20e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.243279 Sep 13 10:21:56.918665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 403/803] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:56 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:57.010677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7ae94723-363a-4fc5-82df-5eb213c547cd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:57.019996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7ae94723-363a-4fc5-82df-5eb213c547cd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1094 microversion: 2.1 time: 0.150304 Sep 13 10:21:57.029102 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 401/804] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:56 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1094 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:57.107819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9caab-c36d-43c3-b09a-362716549fce", "name": "network-vif-plugged", "status": "completed", "tag": "6a9e22f8-803d-4cec-b60d-b75dbadaf04e"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:21:57.132216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.133458 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.138107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.164090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] Creating event network-vif-plugged:6a9e22f8-803d-4cec-b60d-b75dbadaf04e for instance a6d9caab-c36d-43c3-b09a-362716549fce on hv-cinder-85427 Sep 13 10:21:57.169892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-5096139c-1612-4997-bdfd-424c885da100 req-050c27b4-6f19-4e80-b417-4de35d526c96 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066523 Sep 13 10:21:57.171442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 404/805] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:21:57.321351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:57.322263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:57.328926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.330120 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.330741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.331637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.332256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.332847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.536137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:57.544913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f0e35fbc-acfe-4c21-af16-2c04fab9dbfb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.227541 Sep 13 10:21:57.554317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 402/806] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:57 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:57.616025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:57.617144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:57.627924 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.628444 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.628887 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.629604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.630135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.630573 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.820884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:57.834285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c9cee3b0-8992-4781-9db6-5a17a96d8a47 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.222862 Sep 13 10:21:57.835659 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 405/807] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:57 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:57.947801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:57.948362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:57.955591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.956014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.956454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:57.957154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:57.957609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:57.958035 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:58.052345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4d0b3de5-15e3-4e0a-ba24-0a534bed998e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:58.053225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4d0b3de5-15e3-4e0a-ba24-0a534bed998e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:58.155407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4d0b3de5-15e3-4e0a-ba24-0a534bed998e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:58.164265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4d0b3de5-15e3-4e0a-ba24-0a534bed998e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1094 microversion: 2.1 time: 0.115008 Sep 13 10:21:58.179573 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 406/808] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:58 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1094 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:21:58.203609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:58.216027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:58.217401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:58.218575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1893bcd7-3c44-40c6-bfca-118f31239f61 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.274872 Sep 13 10:21:58.219138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 403/809] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:57 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:58.569016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:58.569669 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:58.576654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:58.577230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:58.577674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:58.578935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:58.579677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:58.580367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:58.790557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:58.799191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6b7e262a-ffe8-4922-8c9c-8015b31a01b4 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.234026 Sep 13 10:21:58.803680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 407/810] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:58 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:58.861127 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:58.861748 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:58.868952 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:58.869823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:58.870529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:58.871622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:58.872543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:58.873165 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.037027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.049934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ba2c551f-e945-4eae-98cd-9b472c8b6962 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1363 microversion: 2.1 time: 0.192654 Sep 13 10:21:59.050809 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 404/811] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:58 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:59.194934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:59.195751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:59.212246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.212755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.213198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.215415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.216292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.217170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.249169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:59.249604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:59.257379 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.257885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.258329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.259116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.259609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.260047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.348428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.359139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-69b800aa-15e5-44b7-979a-80245ea4ce63 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1136 microversion: 2.1 time: 0.168058 Sep 13 10:21:59.375730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 408/812] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:59 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1136 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:21:59.486387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.495958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.497714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.499014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-95161553-906e-4078-833f-7173927d2339 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.254874 Sep 13 10:21:59.499662 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 405/813] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:21:59 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:21:59.826199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:21:59.826812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:21:59.833408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.835245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.835245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.835245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:21:59.835527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:21:59.835954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:21:59.981448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:21:59.990301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f370ea45-b56e-425e-8b20-cadac1383b5e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.167723 Sep 13 10:22:00.011942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 409/814] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:21:59 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:00.074014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:00.074663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:00.082982 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.083675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.084476 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.089387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.089996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.090453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.241526 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:00.249341 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0d1748a5-f5e1-4c39-b9c5-f884f9cbf62d tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1549 microversion: 2.1 time: 0.180368 Sep 13 10:22:00.250516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 406/815] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:00 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:00.274926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:00.275527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:00.284442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.285418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.287445 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.292073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.292073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.292073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.388650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:00.389729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:00.409056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.409814 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.412678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.412678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.412678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.412678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.484077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f858b1f0-f623-4be5-8f52-0dce70fa0d49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212972 Sep 13 10:22:00.485203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 410/816] 10.222.0.62 () {58 vars in 1275 bytes} [Tue Sep 13 10:22:00 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:00.506307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:00.518961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cdaa690c-52e4-4ef5-85f9-59913a8ba72e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1192 microversion: 2.1 time: 0.139024 Sep 13 10:22:00.521517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 407/817] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:00 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1192 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:00.533875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:00.536199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:00.559117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.560577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.561312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.562342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:00.562810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:00.563243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:00.812715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:00.840753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:00.842934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:00.856628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-07663dcc-d832-485a-970f-b55642dd00f0 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.330064 Sep 13 10:22:00.857615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 411/818] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:00 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:01.013447 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:01.014272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:01.020750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.021242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.021786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:01.022401 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.022819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.023266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:01.313364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:01.324091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-96f11081-5706-4741-add5-ac0cfec6d099 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.314618 Sep 13 10:22:01.332132 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 408/819] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:01 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:01.549280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:01.551539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:01.556197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.556842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.557353 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:01.558135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.558700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.559315 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:01.888110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:01.888738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:01.895776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.896277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.897216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:01.898146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:01.898760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:01.899387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:02.160369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:02.170263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-58fe3890-575e-4f2f-b243-164d1a032b40 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1278 microversion: 2.1 time: 0.625212 Sep 13 10:22:02.172715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 412/820] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:01 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1278 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:02.200704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d9caab-c36d-43c3-b09a-362716549fce", "tag": "6a9e22f8-803d-4cec-b60d-b75dbadaf04e"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:02.207556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:02.217104 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:02.220170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:02.221652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-49d28fc8-5630-4a64-b6bf-fac25b9b0404 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1739 microversion: 2.20 time: 0.338402 Sep 13 10:22:02.222689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 409/821] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:01 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:22:02.231719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:02.235413 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:02.235413 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:02.250943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] Creating event network-changed:6a9e22f8-803d-4cec-b60d-b75dbadaf04e for instance a6d9caab-c36d-43c3-b09a-362716549fce on hv-cinder-85427 Sep 13 10:22:02.259441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-51a298d5-f9ae-440c-bd48-3ce6bd5582af req-57b0228f-1d0d-432a-b1ea-6eae7b870a5e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060993 Sep 13 10:22:02.259441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 413/822] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:02.351113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:02.352449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:02.362055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:02.363050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:02.365338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:02.367356 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:02.368068 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:02.369559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:02.783378 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:02.791944 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-47a82fb3-c5d2-45d6-89e8-52ec58851864 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.447308 Sep 13 10:22:02.803678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 410/823] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:02 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:03.200655 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:03.207316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:03.214948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.215713 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.216156 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.216868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.217379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.217750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.249763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:03.250408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:03.263048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.263048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.263048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.263048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.263392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.263392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.582209 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:03.584514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:03.590672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bd1ed662-0f56-4900-bb05-74949629b13c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.394339 Sep 13 10:22:03.591261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 414/824] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:03 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:03.617585 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:03.627550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:03.630318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:03.631901 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1f046d5e-eadd-4768-92f8-79a0cde80187 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1721 microversion: 2.20 time: 0.386807 Sep 13 10:22:03.632602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 411/825] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:03 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:03.786356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7076380-769c-4eca-8ad6-75ec464b6010", "tag": "d433bce5-ddb4-4a98-b0a8-0d99788a0849"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:03.796147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.796666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.797086 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.809189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] Creating event network-changed:d433bce5-ddb4-4a98-b0a8-0d99788a0849 for instance f7076380-769c-4eca-8ad6-75ec464b6010 on hv-cinder-85427 Sep 13 10:22:03.815485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-ce8e3bdc-d054-466e-985c-074c729876ff req-2ade5e34-60b9-4026-922c-6d034a950529 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032886 Sep 13 10:22:03.816058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 415/826] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:03.817595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:03.818212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:03.824290 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.824782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.825603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.826295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:03.826744 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:03.827202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:03.963036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:03.970763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-53ad2198-0b4d-46a9-95d9-256b45987ea9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.158880 Sep 13 10:22:03.971355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 412/827] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:03 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:04.617274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:04.617970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:04.624690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:04.625175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:04.625606 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:04.626296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:04.626751 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:04.627200 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:04.660586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:04.661347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:04.668097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:04.668586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:04.669019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:04.669727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:04.670305 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:04.670745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:04.813698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:04.825485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-99c9b7c1-686c-4b96-a386-bad08aef7bad tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.213269 Sep 13 10:22:04.837191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 416/828] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:04 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:04.846458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:04.854768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:04.856268 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:04.857436 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b374e898-e6f6-48d2-a3d7-ffd4e4264ba4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1721 microversion: 2.20 time: 0.202060 Sep 13 10:22:04.857992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 413/829] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:04 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:04.993860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:04.994572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:05.000602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.004840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.004840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:05.004840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.004840 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.005221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:05.134136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:05.142731 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8aac8b1e-5271-4c5c-a44b-6154d56b0df5 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.152112 Sep 13 10:22:05.143392 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 417/830] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:04 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:05.848006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:05.848627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:05.850590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:05.856098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.856588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.857027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:05.857733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.858191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.858823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:05.883487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:05.884098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:05.890795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.891311 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.891747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:05.892904 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:05.893083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:05.893683 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.157014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:06.164882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:06.170151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7920c078-8d3d-4e65-98a6-b6263b38074f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.321994 Sep 13 10:22:06.170151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 414/831] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:05 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:06.171595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:06.172336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:06.174121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:06.175735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:06.176982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6555cb8c-84fd-4dd1-ab20-6ea5738aab2d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1724 microversion: 2.20 time: 0.297608 Sep 13 10:22:06.177623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 418/832] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:05 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:22:06.178724 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:06.179243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:06.179878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.180575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:06.181037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:06.181608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.204311 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86b8537c-6a92-409f-99bb-7ab5c35867a8"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:06.206692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:06.212759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:06.214681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:06.214681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.214681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:06.214936 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:06.215805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.314859 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:06.318407 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:06.323291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9e8bbb4e-3d5f-47e6-bf2b-83520ef632e7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.155428 Sep 13 10:22:06.323946 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 415/833] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:06 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:06.759481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "name": "network-vif-unplugged", "status": "completed", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:06.772464 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:06.773323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:06.773754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:06.786349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.compute.server_external_events [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] Unable to find a host for instance a9a6c608-489a-41f5-b4ff-8c2a248af808. Dropping event network-vif-unplugged {{(pid=121003) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 10:22:06.787149 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-1abb5477-217d-48ca-8920-4784378aeaf3 req-3b1eb495-9e75-4104-8c83-3d20461aca27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033542 Sep 13 10:22:06.787964 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 416/834] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 10:22:07.190334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:07.190973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:07.193246 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=8 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:07.197969 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.198534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.198971 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.199678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.200148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.200586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.344099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:07.352092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-69393122-9af6-4ec6-94bf-527ad450f0ea tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.166264 Sep 13 10:22:07.352749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 417/835] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:07 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:07.357128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:07.357726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:07.361087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6103f8d4-ea30-4d07-bfcc-1557a8b5606b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.160364 Sep 13 10:22:07.362064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 419/836] 10.222.0.62 () {62 vars in 1364 bytes} [Tue Sep 13 10:22:06 2022] POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 10:22:07.365634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.366127 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.366568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.367291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.367753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.368270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.493220 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:07.493718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:07.500411 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.500899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.501346 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.502045 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:07.502495 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:07.502917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:07.515984 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:07.535839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-37932b5e-f6f1-4e46-be8a-825c1b53c029 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.170853 Sep 13 10:22:07.535839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 418/837] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:07 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:08.091658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-932c872c-8903-42da-9e0b-5db5cfa6ed0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments/86b8537c-6a92-409f-99bb-7ab5c35867a8" status: 202 len: 0 microversion: 2.20 time: 0.602273 Sep 13 10:22:08.092198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 420/838] 10.222.0.62 () {60 vars in 1457 bytes} [Tue Sep 13 10:22:07 2022] DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments/86b8537c-6a92-409f-99bb-7ab5c35867a8 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 10:22:08.154443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:08.155045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:08.161342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.161837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.162283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.162967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.163463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.163893 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.193253 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121003) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 10:22:08.376981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:08.377525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:08.379416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:08.384845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.385331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.385771 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.386483 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.386927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.387415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.527809 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:08.535500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ce765686-5d1b-4730-b47d-91dbfa31c3f3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.162986 Sep 13 10:22:08.536189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 421/839] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:08 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:08.547258 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-43ad5169-2170-45a3-854d-5380be761f8f tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/action" status: 202 len: 0 microversion: 2.20 time: 0.397000 Sep 13 10:22:08.548775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:08.549045 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 419/840] 10.222.0.62 () {62 vars in 1319 bytes} [Tue Sep 13 10:22:08 2022] POST /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:22:08.549709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:08.555965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.556544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.557116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.557931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.558148 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:08.558458 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.559490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:08.559577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.567353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.567868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.568491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.569396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:08.569849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:08.570273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:08.772382 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:08.776100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:08.782957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:08.784469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:08.784709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bbcc0c90-07d7-42f0-ab8a-80f71c7921f3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.240357 Sep 13 10:22:08.785389 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 422/841] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:08 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:08.786530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7b2d9b11-97ea-48a4-9b1d-1ffbc4c85b15 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1672 microversion: 2.20 time: 0.232929 Sep 13 10:22:08.790838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 420/842] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:08 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:09.563020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:09.564499 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:09.575147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.575147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.575147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:09.575147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.575846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.575846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:09.726280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:09.734127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f734ce12-ced1-48a2-8918-12b9cf74101a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.175777 Sep 13 10:22:09.735709 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 423/843] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:09 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:09.808754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:09.809412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:09.817414 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.819602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.820057 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:09.820416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:09.820774 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.821215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:09.821314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.821669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:09.828922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.830054 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.830485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:09.831211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:09.831689 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:09.832485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.037541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.040617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.049024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-41c12635-aa3c-4f24-bb31-aca492a64a48 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1570 microversion: 2.1 time: 0.243084 Sep 13 10:22:10.050632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.050878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 421/844] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:09 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:10.060974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.060974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ea30f317-327d-4dda-bb10-a85b3ea65e1a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1672 microversion: 2.20 time: 0.237417 Sep 13 10:22:10.060974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 424/845] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:09 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:22:10.086026 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:10.086759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:10.093334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.093652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.094154 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.094964 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.095477 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.095903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.126966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121003) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 10:22:10.397841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1f986937-e33e-4b21-a021-d25310dae31a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "POST /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571/action" status: 202 len: 0 microversion: 2.1 time: 0.315638 Sep 13 10:22:10.398456 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 422/846] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:22:10 2022] POST /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:22:10.407472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:10.408091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:10.425266 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.425798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.431128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.431918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.432388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.432820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.584556 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.593555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-01879a06-0ce9-470c-8437-656b4d6fae8c tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1578 microversion: 2.1 time: 0.190507 Sep 13 10:22:10.594123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 425/847] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:10 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:10.762147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:10.763983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:10.771471 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.772372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.774135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.775498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:10.775976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:10.776415 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:10.917735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:10.927517 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3eba3c59-54c7-4107-8b89-2f7c532e6cb2 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.171520 Sep 13 10:22:10.928214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 423/848] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:10 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:11.084935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:11.085834 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:11.091955 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.092638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.093076 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:11.093780 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.094232 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.094774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:11.321490 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:11.325272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:11.341265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:11.342921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:11.344108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1b21ce6b-17de-479d-9722-9194037aac98 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.263325 Sep 13 10:22:11.345154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 426/849] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:11 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:11.619533 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:11.620265 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:11.626384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.626948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.627489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:11.628251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.628781 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.629281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:11.836299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:11.844177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4ef2f2ad-7fb0-430a-ae72-4181463d9807 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1518 microversion: 2.1 time: 0.228628 Sep 13 10:22:11.845430 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 424/850] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:11 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:11.957723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:11.961318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:11.971593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.972260 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.973000 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:11.973900 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:11.974483 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:11.975685 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.118906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:12.128888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-db4c045a-d1eb-4c77-b7b8-0dd171a8f555 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.180247 Sep 13 10:22:12.129514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 427/851] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:11 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:12.372286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:12.373082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:12.379693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:12.380187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:12.380625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.381413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:12.381994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:12.382426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.532166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:12.541804 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:12.544510 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:12.545052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-424a6f15-aef1-413b-bae4-42f3dbe448b3 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.176535 Sep 13 10:22:12.545785 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 425/852] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:12 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:12.868130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:12.868878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:12.878388 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:12.878641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "name": "network-vif-unplugged", "status": "completed", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:12.881007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:12.881007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.881290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:12.881750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:12.882175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.898417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:12.899387 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:12.900004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:12.925275 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.compute.server_external_events [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] Unable to find a host for instance c5e3aa48-e46d-4063-bec2-139465c7b571. Dropping event network-vif-unplugged {{(pid=121003) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 10:22:12.928336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-3730fff4-ed4b-4cc5-990e-67216eeba0b3 req-28a2251e-f522-4379-977a-4b019a06b6d8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053561 Sep 13 10:22:12.939396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 426/853] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 10:22:13.062952 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:13.071645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-94336631-5ea9-4108-8b97-b84b109d1be9 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.207176 Sep 13 10:22:13.080270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 428/854] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:12 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:13.152909 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:13.153578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:13.160640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:13.161132 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:13.161576 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:13.162288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:13.162741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:13.163188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:13.363412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:13.372384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5e2f32eb-dd5c-4cfb-bcf7-476e1b007756 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.223550 Sep 13 10:22:13.373611 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 427/855] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:13 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:13.573287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:13.574210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:13.585092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:13.585704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:13.586210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:13.587032 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:13.587585 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:13.588082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:13.728839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:13.737690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:13.739202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:13.740370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-84bc64ad-b4dd-4a9f-83a3-60e0e83fa3a4 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.171177 Sep 13 10:22:13.740933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 429/856] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:13 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:14.104783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:14.105430 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:14.112354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.112995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.113528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.114266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.114819 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.115274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.300187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:14.310940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-95134c0a-98c0-4016-a15a-ffa282186f0d tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.210438 Sep 13 10:22:14.311564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 428/857] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:14 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:14.403151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:14.403897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:14.410243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.412127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.412127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.412127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.412531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.413187 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.589219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:14.598291 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7443ec38-ae24-4ce3-8d57-24e2ce02154f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.199727 Sep 13 10:22:14.598967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 430/858] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:14 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:14.766217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:14.767626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:14.774327 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.775312 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.775763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.776725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:14.777595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:14.778186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:14.933758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:14.953297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:14.955085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:14.956503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-32a59d6d-45f3-47d7-866d-f22aaf153bfa tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.194426 Sep 13 10:22:14.971368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 429/859] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:14 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:15.334901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:15.335700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:15.342459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.342948 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.343409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:15.344108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.345126 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.345551 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:15.531694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:15.544245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a2f6a1fe-e3db-4036-ba2f-aba051d81ced tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.213645 Sep 13 10:22:15.552733 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 431/860] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:15 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:15.621979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:15.623372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:15.630563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.631326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.631928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:15.633034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.633659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.634273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:15.798337 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:15.806755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6331d9be-d79e-40dc-bae7-64454b190bb8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.188599 Sep 13 10:22:15.807349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 430/861] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:15 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:15.985642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:15.987962 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:15.994804 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.995325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.995764 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:15.996469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:15.996926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:15.997383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:16.146265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:16.155305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:16.157182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:16.158426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-164a2b72-5208-46fd-8efb-6f32f8fd903b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.177335 Sep 13 10:22:16.159214 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 432/862] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:15 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:22:16.567055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:16.567697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:16.573885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:16.574919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:16.575735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:16.576749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:16.577483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:16.578206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:16.722129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:16.726530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:16.732910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b5deffa1-20a4-4aef-97b3-92ad92d7693f tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.169713 Sep 13 10:22:16.733623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 431/863] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:16 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:16.832714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:16.833975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:16.841814 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:16.842617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:16.843053 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:16.848008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:16.848008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:16.848008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:16.988982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:16.996790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8d275beb-ebca-4874-9c25-d4407a858a80 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.170699 Sep 13 10:22:16.997364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 433/864] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:16 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:17.185535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:17.186270 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:17.193118 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:17.193670 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:17.194052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:17.194771 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:17.195292 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:17.195723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:17.353759 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:17.362212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:17.363686 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:17.364862 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-56522249-a3f5-43e7-9998-d6f9f0244c68 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.183689 Sep 13 10:22:17.372642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 432/865] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:17 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:17.756247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:17.756855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:17.762715 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:17.763210 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:17.763641 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:17.764349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:17.764791 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:17.765208 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:17.923653 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:17.931531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-05631b44-884e-4b4f-9c30-0f227aa2cbcb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.179217 Sep 13 10:22:17.932363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 434/866] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:17 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:18.020852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:18.021657 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:18.029020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.029513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.030011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:18.030723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.031198 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.031858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:18.196931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:18.206064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-11b6c65d-e37d-4342-b46c-2f02100dcf07 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.189758 Sep 13 10:22:18.207573 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 433/867] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:18 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:18.391878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:18.392843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:18.399418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.400177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.400862 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:18.401820 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.402864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.403324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:18.543142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:18.551863 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:18.553336 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:18.554602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-41de06a2-dc18-4879-81e6-5586ac900390 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.167485 Sep 13 10:22:18.555250 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 435/868] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:18 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:18.955753 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:18.956390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:18.963134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.963652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.964110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:18.964803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:18.965283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:18.965704 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:19.133749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:19.146309 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9d2e2ed8-dadd-4f7b-855f-414e507e00af tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.193312 Sep 13 10:22:19.149633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 434/869] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:18 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:19.234226 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:19.235646 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:19.243280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:19.243769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:19.244211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:19.248098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:19.248098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:19.248098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:19.428396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:19.436237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2285be3e-171f-4faa-add7-c479075400fe tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.205808 Sep 13 10:22:19.444223 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 436/870] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:19 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:19.580504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:19.581152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:19.587181 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:19.587701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:19.588144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:19.588847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:19.589357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:19.589789 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:19.744194 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:19.753156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:19.756740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:19.757997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9608ee62-45de-4027-814b-05d29e76a868 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.181495 Sep 13 10:22:19.758769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 435/871] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:19 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:20.173443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:20.176146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:20.180237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.180860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.181362 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.182120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.182640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.183130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.327248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:20.335913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fc263823-d09e-4799-a955-dc8d5c15a9da tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.166550 Sep 13 10:22:20.336613 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 437/872] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:20 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:20.460372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:20.460987 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:20.471949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.471949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.471949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.471949 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.472448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.472448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.616203 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:20.624016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-204b3aa9-c538-44e9-83ee-c0bf828a82c5 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.167455 Sep 13 10:22:20.624589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 436/873] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:20 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:20.788184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:20.788897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:20.795542 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.796119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.796618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.798349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:20.798880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:20.799457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:20.962535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:20.963006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:20.964475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:20.965645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a5c6954b-1c79-46bb-bd3c-1e4b160bdb91 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.181392 Sep 13 10:22:20.966198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 438/874] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:20 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:21.363455 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:21.364106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:21.371022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:21.371803 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:21.372453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:21.373471 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:21.374146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:21.374579 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:21.531980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:21.540077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6a856f70-6c2c-4bff-a436-6ebb55673a71 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.183193 Sep 13 10:22:21.550144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 437/875] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:21 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:21.646547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:21.647179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:21.653535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:21.654012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:21.654437 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:21.655117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:21.655590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:21.656008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:21.800655 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:21.810331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-04099f0e-2f0e-43e5-a13b-d7a8de81dfca tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.167206 Sep 13 10:22:21.825810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 439/876] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:21 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:21.993257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:21.993812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:21.999925 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.000431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.000876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.001564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.002017 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.002441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.134463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:22.144873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:22.146570 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:22.148027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-97da47f4-ad39-4115-868d-f2d2416ee921 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.158743 Sep 13 10:22:22.148597 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 438/877] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:21 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:22.565370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:22.566087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:22.571958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.572446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.572884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.573572 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.574028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.574453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.709303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:22.717146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-aa3809fd-d976-44f0-bed6-922f795f3f25 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.156158 Sep 13 10:22:22.717806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 440/878] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:22 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:22.832907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:22.833608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:22.840522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.841138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.841642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.842534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:22.843063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:22.843603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:22.981482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:22.990004 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0a0535b8-ae19-4063-993b-5ce6ef18ec77 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.161082 Sep 13 10:22:22.990664 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 439/879] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:22 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:23.173960 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:23.174696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:23.183368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:23.186141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:23.186141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:23.186141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:23.186141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:23.186523 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:23.321611 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:23.329765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:23.338033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:23.338033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d9d570b0-6d7f-4274-85b3-f37d3547c274 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.162398 Sep 13 10:22:23.338033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 441/880] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:23 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:23.740609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:23.741426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:23.754516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:23.754516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:23.754516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:23.754516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:23.755504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:23.755504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:23.898551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:23.908110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-83d0556f-1d80-4725-b0cc-51fc0eaffb91 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1520 microversion: 2.1 time: 0.171257 Sep 13 10:22:23.908889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 440/881] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:23 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:24.014006 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:24.014616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:24.021500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.022415 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.022672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.023511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.024063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.024564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.163270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:24.171758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1bef4709-3db6-4545-95eb-2b9ebb7a181f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.161824 Sep 13 10:22:24.172974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 442/882] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:24 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:24.358103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:24.358717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:24.365173 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.367678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.367678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.367678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.367678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.368052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.502989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:24.511319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:24.512915 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:24.514138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e50bfa86-5cee-49a7-af95-6c4bd89145de tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.160112 Sep 13 10:22:24.514695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 441/883] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:24 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:24.931269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:24.932025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:24.938120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.938658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.939349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.940795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:24.941562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:24.942443 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:24.961929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=100 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:25.142406 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:25.150761 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6563ca58-3361-4f29-aa82-fc41dc69fa8e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.223387 Sep 13 10:22:25.151462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 443/884] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:24 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:25.197110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:25.208752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:25.216213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:25.216786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:25.217321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:25.218110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:25.218663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:25.219830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:25.356279 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:25.364080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c3fe740b-865e-4f2e-ac3d-95687ebeeb56 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.171219 Sep 13 10:22:25.364649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 442/885] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:25 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:25.541154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:25.542273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:25.544581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=92 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:25.549464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:25.549954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:25.552047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:25.552047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:25.552047 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:25.552416 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:25.680596 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:25.689092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:25.690544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:25.691773 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b6464aa4-9724-4ac1-99a6-78594db3102a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.154619 Sep 13 10:22:25.695923 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 444/886] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:25 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:26.176390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:26.177002 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:26.182968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.183493 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.183934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.184626 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.185084 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.185513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.317988 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:26.325849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cddd4841-5e9a-4726-9e38-1ff70b80357a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.153918 Sep 13 10:22:26.326411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 443/887] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:26 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:26.387541 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:26.388189 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:26.394805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.395332 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.395770 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.396464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.396925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.397350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.530963 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:26.539117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c4f6f591-8676-4ad7-8099-e9e93fd8d013 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.155385 Sep 13 10:22:26.539699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 445/888] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:26 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:26.717834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:26.718463 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:26.721421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:26.725624 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.726101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.726559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.727263 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:26.727712 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:26.728129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:26.863380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:26.871768 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:26.875581 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:26.876831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f876afe2-a6a8-4624-9e3d-0b3b2ef79542 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.162865 Sep 13 10:22:26.877513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 444/889] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:26 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 10:22:27.120339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7076380-769c-4eca-8ad6-75ec464b6010", "name": "network-vif-plugged", "status": "completed", "tag": "d433bce5-ddb4-4a98-b0a8-0d99788a0849"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:27.130784 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.131256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.131693 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.143312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] Creating event network-vif-plugged:d433bce5-ddb4-4a98-b0a8-0d99788a0849 for instance f7076380-769c-4eca-8ad6-75ec464b6010 on hv-cinder-85427 Sep 13 10:22:27.148417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-8a30a76b-9995-4e38-88a1-6708823ea640 req-96541888-0bb1-40c3-a1e7-995a5660320d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Sep 13 10:22:27.149087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 446/890] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:27.348970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:27.349504 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:27.355836 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.356326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.356771 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.357479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.357939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.358359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.496894 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:27.505677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3910bdd1-df67-4ee5-adc6-c70426416307 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.160738 Sep 13 10:22:27.509745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 445/891] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:27 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:27.563554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:27.564256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:27.570399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.570875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.571339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.572021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.572468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.572888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.636979 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:27.637399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:27.643299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.643791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.644236 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.644935 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.645392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.645821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.669756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-65d46dd0-2b41-4f2e-b8c1-24de720988b7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036723 Sep 13 10:22:27.670336 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 446/892] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:22:27 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:22:27.708217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:27.716486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b1a790d0-53f1-49d8-b42e-e0587229a25f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.158193 Sep 13 10:22:27.717146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 447/893] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:27 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:27.903942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:27.904478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:27.911046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.911563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.912051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:27.913006 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:27.913514 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:27.913899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:28.043107 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:28.051319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:28.052867 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:28.054020 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bffde88a-11e8-48fd-98a2-0571615b2c87 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.154470 Sep 13 10:22:28.054583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 447/894] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:27 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:28.530505 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:28.531249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:28.537290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:28.537777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:28.538215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:28.538905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:28.539395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:28.539823 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:28.670812 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:28.678738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-91182b47-815f-4775-abf8-549c65a950b0 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.152930 Sep 13 10:22:28.679349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 448/895] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:28 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:28.740396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:28.742331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:28.748883 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:28.751388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:28.751388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:28.751388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:28.752040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:28.752040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:28.886205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:28.889689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=100 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:28.894328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b236a915-3c60-43ac-84ab-9a40d8f8d119 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1266 microversion: 2.1 time: 0.157892 Sep 13 10:22:28.901428 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 448/896] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:28 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:29.079593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:29.080302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:29.086133 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.086679 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.087133 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.087842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.088288 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.088736 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.165919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "name": "network-vif-plugged", "status": "completed", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:29.189036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.189735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.190349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.206025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] Creating event network-vif-plugged:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:22:29.214015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-408d0dd1-f2ad-484a-9f78-956ac0b1366c req-391225e7-60c6-4d48-8033-6fee6f46f36c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052864 Sep 13 10:22:29.215365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 449/897] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:29.364393 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae369b82-8ad9-455c-9fa4-eecdf5c4d9e2"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:29.366930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:29.382999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.383904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.384347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.385210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.385677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.386150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.506587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:29.514848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:29.517206 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:29.518446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5e2b24dd-1867-487e-a27f-996b105b1c84 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.442701 Sep 13 10:22:29.519003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 449/898] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:29 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:29.701852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:29.704211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:29.709889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.710492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.711031 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.712221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.712884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.713423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.850070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:29.858175 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-05908d74-3505-4d96-8522-cd6fd8b93e77 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.160388 Sep 13 10:22:29.859129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 450/899] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:29 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:29.917952 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:29.918662 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:29.924841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.931337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.931337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:29.931337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:29.931337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:29.931801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.060747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:30.075439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6977adb0-7800-495d-8e49-9f5f8f453f0e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1453 microversion: 2.1 time: 0.157402 Sep 13 10:22:30.075439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 451/900] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:29 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:30.094113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:30.094722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:30.100675 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.103594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.103594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.103594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.103594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.104018 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.241680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:30.244501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9cbcaa6e-4c7e-40c1-ac10-b62f88a5b29a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "POST /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.885000 Sep 13 10:22:30.251946 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 450/901] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:22:29 2022] POST /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:22:30.252083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d9c8302b-8d5b-4332-ab4d-851c2887c326 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1453 microversion: 2.1 time: 0.160797 Sep 13 10:22:30.263534 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 452/902] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:30 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:30.547675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:30.548303 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:30.590075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.590075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.590075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.590075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.590549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.590549 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.694384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:30.705028 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:30.706470 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:30.707853 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-51ef2a29-5bf1-4159-a953-b77050804720 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.166547 Sep 13 10:22:30.710679 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 451/903] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:30 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:30.881649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:30.882460 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:30.890444 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.891196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.891702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:30.894153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:30.894153 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:30.894466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:31.047077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:31.055008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f32b20ff-b45e-4689-899b-933a702e773a tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.177345 Sep 13 10:22:31.055639 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 453/904] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:30 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:31.736318 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:31.737079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:31.743588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:31.744065 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:31.744692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:31.745385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:31.746018 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:31.746438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:31.897635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:31.911072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:31.912602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:31.913770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9fe5a43a-0364-48d2-9768-f4ad3f8ee515 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.183672 Sep 13 10:22:31.914315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 452/905] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:31 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:32.078003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:32.078663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:32.085207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:32.085685 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:32.086115 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:32.086843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:32.087328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:32.087754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:32.241235 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:32.250218 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1b8c42af-6409-4224-aea5-0967187a7ed7 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.176010 Sep 13 10:22:32.250808 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 454/906] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:32 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:32.430251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7076380-769c-4eca-8ad6-75ec464b6010", "tag": "d433bce5-ddb4-4a98-b0a8-0d99788a0849"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:32.440756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:32.441529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:32.442094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:32.461342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] Creating event network-changed:d433bce5-ddb4-4a98-b0a8-0d99788a0849 for instance f7076380-769c-4eca-8ad6-75ec464b6010 on hv-cinder-85427 Sep 13 10:22:32.466430 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-968995cf-8c90-4ab0-b2e3-90eca458402d req-abb686f8-042e-470a-ae11-970a119d321d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039892 Sep 13 10:22:32.467259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 453/907] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:32.941880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:32.942182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:32.968742 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:32.969331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:32.969777 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:32.970654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:32.971113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:32.971744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:33.136698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:33.145707 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:33.150718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:33.150718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c52f23e9-5fa0-4578-b1c5-1ddb1af45e1d tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1730 microversion: 2.20 time: 0.211764 Sep 13 10:22:33.150718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 455/908] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:32 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:33.274730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:33.275486 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:33.282288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:33.282782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:33.283381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:33.284093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:33.284550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:33.285187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:33.431003 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:33.443887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bb976e47-052e-4f6d-926a-2a8a9ea8f095 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.174175 Sep 13 10:22:33.445589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 454/909] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:33 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:34.174062 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:34.174676 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:34.181578 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:34.182057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:34.182492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:34.183199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:34.183658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:34.184083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:34.314150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:34.322199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:34.323674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:34.324826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-49db2d17-b816-4452-9381-6d113ded8d88 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1717 microversion: 2.20 time: 0.154637 Sep 13 10:22:34.325379 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 456/910] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:22:34 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:22:34.468106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:34.468658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:34.475138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:34.475652 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:34.476092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:34.476782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:34.477244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:34.477673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:34.612173 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:34.619796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cfbefe57-15ac-4a63-a9f7-547a886d1b87 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.155699 Sep 13 10:22:34.620359 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 455/911] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:34 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:35.643959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:35.644478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:35.650784 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:35.651335 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:35.652020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:35.652721 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:35.653171 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:35.653594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:35.788914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:35.796623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-37cbebda-03a3-4c75-af46-798b7c678b93 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.157377 Sep 13 10:22:35.797191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 457/912] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:35 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:36.819612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:36.820225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:36.826957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:36.827479 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:36.827923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:36.828612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:36.829067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:36.829530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:36.966895 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:36.974847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4f5c593a-abd8-43a3-abbf-8dadbadf598e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.159056 Sep 13 10:22:36.975442 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 456/913] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:36 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:37.818846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "name": "network-vif-plugged", "status": "completed", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:37.828632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:37.829130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:37.830038 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:37.840561 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] Creating event network-vif-plugged:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:22:37.846083 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-090db946-431b-45d3-9800-5da2e9837416 req-fedc2a20-83d2-4f83-8cff-46e45eb4c964 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030226 Sep 13 10:22:37.846671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 458/914] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:37.997801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:37.998416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:38.004837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:38.005320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:38.005755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:38.006443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:38.006897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:38.007360 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:38.142661 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:38.150435 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-78c064a6-770e-42a4-9ed1-e5c2ee7be762 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.156458 Sep 13 10:22:38.151013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 457/915] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:37 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:38.983648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:38.984229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:38.990330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:38.990816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:38.991279 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:38.991965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:38.992421 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:38.992849 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:39.073157 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'services' on Instance uuid 75681e9a-70e7-4876-a644-7da412c384c5 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:22:39.173272 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:39.173824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:39.180256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:39.180741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:39.181180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:39.181872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:39.182329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:39.182757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:39.314419 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1a3f31ee-25ff-4fb9-84a0-6b92a4cbff25 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments/ae369b82-8ad9-455c-9fa4-eecdf5c4d9e2" status: 202 len: 0 microversion: 2.1 time: 0.334722 Sep 13 10:22:39.315251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 459/916] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:22:38 2022] DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments/ae369b82-8ad9-455c-9fa4-eecdf5c4d9e2 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:22:39.320177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:39.324048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:39.326558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:39.328137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c14bb8d6-0d71-4a07-9b4f-5d55e104ac45 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1576 microversion: 2.1 time: 0.158761 Sep 13 10:22:39.328701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 458/917] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:39 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:22:39.333730 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:39.334422 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:39.334866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:39.335638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:39.336301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:39.336922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:39.363364 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:39.368080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bb133d64-e109-4023-90b1-806de801b5a1 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Sep 13 10:22:39.368720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 460/918] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:22:39 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:22:40.352144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:40.352997 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:40.359449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:40.359957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:40.361007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:40.361721 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:40.362202 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:40.362654 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:40.385492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:40.385492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:40.392444 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:40.393262 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:40.393898 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:40.394829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:40.395525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:40.396148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:40.436148 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-769a4bc0-2af5-43a8-aab5-17a0f3384889 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058661 Sep 13 10:22:40.436774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 461/919] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:22:40 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:22:40.523887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:40.533030 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-85577c53-8e4d-4c42-9a1c-318c59445f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1563 microversion: 2.1 time: 0.184254 Sep 13 10:22:40.540234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 459/920] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:40 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:41.449195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:41.451373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:41.458743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.459261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.459703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:41.460389 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.460843 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.461270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:41.489854 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2d62d077-dc18-454c-95fa-3bfb73625839 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044963 Sep 13 10:22:41.490442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 462/921] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:22:41 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:22:41.557539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:41.558055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:41.565063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.565546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.565981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:41.566667 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.567121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.567571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:41.591727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:22:41.900462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-420fb3aa-aa3c-4dbb-8336-c450239601a0 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 204 len: 0 microversion: 2.1 time: 0.346487 Sep 13 10:22:41.901047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 460/922] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:22:41 2022] DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:22:41.910008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:41.910616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:41.916564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.917046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.917476 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:41.918186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:41.918637 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:41.919059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:42.046677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:42.054868 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-65822a6f-56cf-43aa-bc9e-250b23f5aa3a tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1681 microversion: 2.1 time: 0.149265 Sep 13 10:22:42.055473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 463/923] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:41 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:43.078475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:43.079189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:43.085702 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:43.086182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:43.086615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:43.087335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:43.087786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:43.088208 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:43.216788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:43.224535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-9206a649-7455-42c6-a5ee-960ae818c75b tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1681 microversion: 2.1 time: 0.150345 Sep 13 10:22:43.225095 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 461/924] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:43 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:44.248369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:44.251564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:44.256463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:44.256953 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:44.257428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:44.258165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:44.258591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:44.259021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:44.469684 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:44.477229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-41570ac4-61c3-4efb-8f64-bde4312a5e52 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1681 microversion: 2.1 time: 0.232891 Sep 13 10:22:44.477797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 464/925] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:44 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:45.077681 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75681e9a-70e7-4876-a644-7da412c384c5", "name": "network-vif-deleted", "tag": "e14a2cd2-7a70-4bcf-b52e-0b0e708566c7"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:45.088330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:45.088754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:45.089390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:45.101264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] Creating event network-vif-deleted:e14a2cd2-7a70-4bcf-b52e-0b0e708566c7 for instance 75681e9a-70e7-4876-a644-7da412c384c5 on hv-cinder-85427 Sep 13 10:22:45.106161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-56e41f14-9d17-4e42-b23d-28bf72b790ad req-b257bd0e-d06f-4a75-9743-cc2d497ca33e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032577 Sep 13 10:22:45.106766 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 462/926] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:22:45.500833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:45.502341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:45.508953 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:45.509674 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:45.510274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:45.511121 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:45.511744 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:45.512417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:45.547113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:45.547694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:45.548092 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:45.548535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lazy-loading 'fault' on Instance uuid 75681e9a-70e7-4876-a644-7da412c384c5 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:22:45.594318 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4067d48268f84854af4d672ab3f9dc65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66658bb98ea64e319ed948b8f279ed5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:22:45.602263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-147a2274-ae9b-4f76-b2ac-1be2bad44a0f tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 200 len: 1332 microversion: 2.1 time: 0.105397 Sep 13 10:22:45.615362 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 465/927] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:45 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:22:46.626498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:46.627241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:46.633859 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:46.634333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:46.634764 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:46.635482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:46.635930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:46.636349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:46.649293 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 HTTP/1.1 Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:22:46.650842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:46.652529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '75681e9a-70e7-4876-a644-7da412c384c5'} Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:46.653299 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:46.654806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:46.656418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:46.656418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8a6e2971-aeb0-4f20-8095-15d30b67ca0d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 404 len: 111 microversion: 2.1 time: 0.030324 Sep 13 10:22:46.656418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 463/928] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:46 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:46.661643 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-017f40ad-19fd-4fec-9002-a41d338884f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '.version_select at 0x7f46c4865160>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:46.731501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-017f40ad-19fd-4fec-9002-a41d338884f7 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074476754" status: 202 len: 0 microversion: 2.1 time: 0.073473 Sep 13 10:22:46.732048 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 466/929] 10.222.0.62 () {58 vars in 1221 bytes} [Tue Sep 13 10:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074476754 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 10:22:48.754502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:48.755027 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:48.761734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:48.762218 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:48.762650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:48.763374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:48.763827 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:48.764251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:48.778512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 HTTP/1.1 Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:22:48.780116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.781677 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '75681e9a-70e7-4876-a644-7da412c384c5'} Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:48.783121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.784605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.786375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:48.786375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5135351b-8d00-4a65-b8bd-869f188614d3 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 404 len: 111 microversion: 2.1 time: 0.030922 Sep 13 10:22:48.786375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 464/930] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:22:48 2022] DELETE /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:48.792597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:48.793213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 75681e9a-70e7-4876-a644-7da412c384c5] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:48.800440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:48.800939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:48.801375 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:48.802091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:48.802544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:48.802968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:48.817696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 HTTP/1.1 Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:22:48.819417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.820990 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '75681e9a-70e7-4876-a644-7da412c384c5'} Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:48.822694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. Sep 13 10:22:48.824224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:48.825487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 75681e9a-70e7-4876-a644-7da412c384c5 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:48.825487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2d9fade7-3c36-48dc-964d-cd9c8e32cfbf tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5" status: 404 len: 111 microversion: 2.1 time: 0.032865 Sep 13 10:22:48.825487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 467/931] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:48 2022] GET /compute/v2.1/servers/75681e9a-70e7-4876-a644-7da412c384c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:50.101443 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:50.101932 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:50.108242 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.108718 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.109147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.109830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.110942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.111400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.124362 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b HTTP/1.1 Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:22:50.125912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.127301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b'} Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:50.128058 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.129520 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.131069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:50.131069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-79223cb0-4251-4aef-aee7-29298de5fd59 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 404 len: 111 microversion: 2.1 time: 0.029650 Sep 13 10:22:50.131069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 465/932] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:22:50 2022] DELETE /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:50.136174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:50.136790 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:50.143214 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.143699 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.144142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.144829 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.145284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.145734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.159647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b HTTP/1.1 Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:22:50.161144 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.162726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b'} Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:50.163545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. Sep 13 10:22:50.164917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.166202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:50.166202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fd5febfd-5238-470e-a059-ca16e3e23471 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b" status: 404 len: 111 microversion: 2.1 time: 0.030154 Sep 13 10:22:50.166202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 468/933] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:50 2022] GET /compute/v2.1/servers/9f6e776f-1d0e-40fe-9231-6b4a52fd5d2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:50.170920 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:50.171461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:50.178001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.178474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.178903 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.179614 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.180063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.180484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.193513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: DELETE /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c HTTP/1.1 Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:22:50.195034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.196735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'cd48156b-79bf-41ef-8a3d-3b5265dae93c'} Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:50.197655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.199114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.200725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:50.200725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-21fc610b-3962-4329-a249-245d7671315d tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 404 len: 111 microversion: 2.1 time: 0.029304 Sep 13 10:22:50.200725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 466/934] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:22:50 2022] DELETE /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:50.205985 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:50.206621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: cd48156b-79bf-41ef-8a3d-3b5265dae93c] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:50.212527 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.213010 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.213448 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.214139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:50.214594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:50.215020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:50.229020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c HTTP/1.1 Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:22:50.230510 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.238537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'cd48156b-79bf-41ef-8a3d-3b5265dae93c'} Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:50.239889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. Sep 13 10:22:50.241377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:50.243129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance cd48156b-79bf-41ef-8a3d-3b5265dae93c could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:50.243129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9501ee73-d0cd-407b-9980-53cc7417a166 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c" status: 404 len: 111 microversion: 2.1 time: 0.029798 Sep 13 10:22:50.243129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 469/935] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:50 2022] GET /compute/v2.1/servers/cd48156b-79bf-41ef-8a3d-3b5265dae93c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:51.504352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:51.504816 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:51.511098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:51.511606 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:51.512038 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:51.512723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:51.513173 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:51.513600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:51.517706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:51.527199 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 HTTP/1.1 Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:22:51.531535 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.533244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '35bddc8a-d8db-4078-83a2-6149b951e279'} Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:51.534106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.535348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.536550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:51.536550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e7c3dc5a-6991-4200-8148-855278b3b697 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 404 len: 111 microversion: 2.1 time: 0.030262 Sep 13 10:22:51.536550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 467/936] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:22:51 2022] DELETE /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:51.538390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:51.538997 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] [instance: 35bddc8a-d8db-4078-83a2-6149b951e279] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:51.545511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:51.545982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:51.546410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:51.547085 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:51.548077 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:51.548824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:51.564941 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] HTTP exception thrown: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Request method failure captured: Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 HTTP/1.1 Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhasagFGSWMNP3lGjA8YAOoPgB4mRUKu1ti-jvvuTpq2qryKnfagPiqdSL7FnqVZuFfzGmbA3hIbGR_yiUmXB2a7gqf8YxMffRZtdq3Ki4Wu6v4D90tzQtlLmc31Mkg1uTgj-4elV35XErJYiV3stbN-vpFV3ABmVaGybq3gav8KzI Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:22:51.566446 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/66658bb98ea64e319ed948b8f279ed5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 66658bb98ea64e319ed948b8f279ed5f Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1978937328 Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 4067d48268f84854af4d672ab3f9dc65 Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeNegativeTest-1978937328-project Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.568013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '35bddc8a-d8db-4078-83a2-6149b951e279'} Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:22:51.569162 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. Sep 13 10:22:51.570609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:22:51.572119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] Returning 404 to user: Instance 35bddc8a-d8db-4078-83a2-6149b951e279 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:22:51.572119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-80a6083f-3c11-41e4-a364-b2a8449a1702 tempest-AttachVolumeNegativeTest-1978937328 tempest-AttachVolumeNegativeTest-1978937328-project] 10.222.0.62 "GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279" status: 404 len: 111 microversion: 2.1 time: 0.033262 Sep 13 10:22:51.572119 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 470/937] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:22:51 2022] GET /compute/v2.1/servers/35bddc8a-d8db-4078-83a2-6149b951e279 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:22:54.898636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:22:54.900134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:54.907329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:54.908034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:54.908900 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:54.910212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:54.910825 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:54.911618 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:54.945820 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2491233f-4e73-4049-9ead-9864a4fbcfcc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/ips" status: 200 len: 146 microversion: 2.1 time: 0.257183 Sep 13 10:22:54.949841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 468/938] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:22:54 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/ips => generated 146 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:22:56.702301 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9836d22-8093-4c97-99ef-e2c607263ce3"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:22:56.705765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:22:56.708397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:22:56.713242 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:56.713624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:56.714064 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:56.714762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:22:56.715237 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:22:56.715670 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:22:57.446649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-25882b46-6d0a-46d6-ad33-9b6d00e96bc4 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748115 Sep 13 10:22:57.447373 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 471/939] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:22:56 2022] POST /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:07.102046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:07.104322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:07.108050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:07.112034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:07.112519 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:07.112951 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:07.113645 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:07.114094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:07.114518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:07.144288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-81d2e6ca-529b-49ad-9b45-93ff13805043 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Sep 13 10:23:07.144835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 469/940] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:23:07 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:07.153562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:07.158355 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:07.161342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:07.164921 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:07.165404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:07.165842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:07.166535 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:07.166993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:07.167455 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:07.196772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-efc3183c-b835-43ee-addb-57f6f13b21cc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3" status: 200 len: 194 microversion: 2.1 time: 0.044903 Sep 13 10:23:07.197366 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 472/941] 10.222.0.62 () {58 vars in 1413 bytes} [Tue Sep 13 10:23:07 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:08.871072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b662072d-df7b-49a4-b2ec-a0c039055d1f"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:08.873403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:08.880769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:08.881247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:08.881678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:08.882384 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:08.882837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:08.883286 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:09.468722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-aa27e2fd-566b-4a2d-8e4f-d92bc94b1eb7 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "POST /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601377 Sep 13 10:23:09.469470 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 470/942] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:23:08 2022] POST /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:12.719246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:12.722125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:12.729325 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:12.729890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:12.730405 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:12.731334 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:12.731861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:12.735779 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:12.736957 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:12.763607 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dc2fc30d-a430-4d5f-8f51-22415cb34b6b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048596 Sep 13 10:23:12.764174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 473/943] 10.222.0.62 () {60 vars in 1343 bytes} [Tue Sep 13 10:23:12 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:23:12.827994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:12.828494 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:12.834821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:12.835357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:12.835797 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:12.836619 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:12.837072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:12.837497 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:12.865209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:23:13.128051 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-69a79dee-5bed-4707-b974-4df4e22e1137 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 204 len: 0 microversion: 2.20 time: 0.304626 Sep 13 10:23:13.128687 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 471/944] 10.222.0.62 () {60 vars in 1280 bytes} [Tue Sep 13 10:23:12 2022] DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 10:23:13.136893 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:13.137554 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:13.144778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:13.145261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:13.145698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:13.146382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:13.146865 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:13.147324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:13.281466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:13.290217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:13.291686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:13.292841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-541a1e87-c6cb-4a2f-aee0-50e88295a83a tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.159774 Sep 13 10:23:13.293401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 474/945] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:13 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:23:14.318417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:14.319126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:14.325521 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:14.326009 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:14.326448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:14.327138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:14.327628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:14.328055 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:14.457129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:14.465288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:14.466745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:14.467941 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0dbe2bc5-ca29-40d4-b5fd-088a1b6852dd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1723 microversion: 2.20 time: 0.153846 Sep 13 10:23:14.468561 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 472/946] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:14 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:23:15.494493 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:15.495093 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:15.504813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:15.507982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:15.507982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:15.507982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:15.507982 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:15.508987 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:15.592229 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:15.602842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:15.604475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:15.608619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9b8677e1-d05a-4c94-b212-1ab6c4f83d06 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1655 microversion: 2.20 time: 0.116701 Sep 13 10:23:15.609305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 475/947] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:15 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1655 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:23:15.817872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a6c608-489a-41f5-b4ff-8c2a248af808", "name": "network-vif-deleted", "tag": "45f38058-5689-489f-80b9-047dafea9f45"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:15.828418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:15.830206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:15.830206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:15.847524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] Creating event network-vif-deleted:45f38058-5689-489f-80b9-047dafea9f45 for instance a9a6c608-489a-41f5-b4ff-8c2a248af808 on hv-cinder-85427 Sep 13 10:23:15.856902 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-bdafe8ca-5666-40b7-b596-cf637bdcc2ff req-e9ab914d-00b2-4986-91e7-f572c44e1bd1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042669 Sep 13 10:23:15.857790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 473/948] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:16.635871 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:16.636540 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:16.643756 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:16.644273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:16.644729 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:16.645414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:16.645867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:16.646290 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:16.680758 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:16.681577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:16.681926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:16.682332 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.objects.instance [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lazy-loading 'fault' on Instance uuid a9a6c608-489a-41f5-b4ff-8c2a248af808 {{(pid=121002) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:23:16.727615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:16.741553 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:16.743199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c069999293a847cdb11650045e22576c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45075d7ec024b3a907d11225942fbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:16.744671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e853217c-ba08-4d58-a206-776b00dc1aa1 tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 200 len: 1370 microversion: 2.20 time: 0.112731 Sep 13 10:23:16.745700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 476/949] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:16 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 10:23:17.042295 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:17.044592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:17.051475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.051966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.052400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.053347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.053807 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.054235 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.085902 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ebd56c51-51c6-46bf-a632-199a5c0e7d77 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048442 Sep 13 10:23:17.086481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 474/950] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:23:17 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:17.228255 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:17.228965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:17.236199 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.236755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.237186 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.237873 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.238529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.238976 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.274683 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a5d62891-82e4-4d8b-9fd2-de6e9d9a0387 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3" status: 200 len: 194 microversion: 2.1 time: 0.050231 Sep 13 10:23:17.275303 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 477/951] 10.222.0.62 () {58 vars in 1413 bytes} [Tue Sep 13 10:23:17 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:17.286640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:17.290798 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:17.293776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.294395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.294892 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.295631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.296226 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.296723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.382793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lazy-loading 'services' on Instance uuid a6d9caab-c36d-43c3-b09a-362716549fce {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:23:17.627302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d464ea3b-9540-43a4-b6f6-a95c09460010 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3" status: 202 len: 0 microversion: 2.1 time: 0.344425 Sep 13 10:23:17.627900 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 475/952] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:23:17 2022] DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/f9836d22-8093-4c97-99ef-e2c607263ce3 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:17.770381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:17.771066 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:17.780149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.780149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.780149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.780149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:17.780511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:17.780511 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 HTTP/1.1 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:17.799116 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:17.800850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a9a6c608-489a-41f5-b4ff-8c2a248af808'} Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:17.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:17.803397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:17.804762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:17.804762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c8330116-1016-4d87-b045-71374b5f4d2c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 404 len: 111 microversion: 2.20 time: 0.032925 Sep 13 10:23:17.804762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 478/953] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:17 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:17.815297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1fa3203c-c468-4cf4-882f-62440948585c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '.version_select at 0x7f46c114e0d0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:17.908544 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1fa3203c-c468-4cf4-882f-62440948585c tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737946431" status: 204 len: 0 microversion: 2.20 time: 0.098420 Sep 13 10:23:17.909175 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 476/954] 10.222.0.62 () {60 vars in 1259 bytes} [Tue Sep 13 10:23:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737946431 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 10:23:19.076959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:19.077463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:19.099782 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:19.100374 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:19.100759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:19.102390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:19.102390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:19.102390 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:19.134072 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-93271dc7-0e59-4973-ab5f-5e6af1b5c5f5 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/b662072d-df7b-49a4-b2ec-a0c039055d1f" status: 200 len: 194 microversion: 2.1 time: 0.061057 Sep 13 10:23:19.134626 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 479/955] 10.222.0.62 () {58 vars in 1413 bytes} [Tue Sep 13 10:23:19 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/b662072d-df7b-49a4-b2ec-a0c039055d1f => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:19.146421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:19.147198 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:19.153690 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:19.154291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:19.154734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:19.155466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:19.155931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:19.156392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:19.241505 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lazy-loading 'services' on Instance uuid a6d9caab-c36d-43c3-b09a-362716549fce {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:23:19.470192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-dea3605c-7adf-4464-ba55-6cfc20666b49 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/b662072d-df7b-49a4-b2ec-a0c039055d1f" status: 202 len: 0 microversion: 2.1 time: 0.327924 Sep 13 10:23:19.470891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 477/956] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:23:19 2022] DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments/b662072d-df7b-49a4-b2ec-a0c039055d1f => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:20.155337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:20.155854 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:20.162681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.163188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.163649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.164350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.164799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.165297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.180513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 HTTP/1.1 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:20.182131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.183703 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a9a6c608-489a-41f5-b4ff-8c2a248af808'} Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:20.184664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.185889 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.188039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:20.188039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5f5fef85-3a24-4c18-acab-79b7661e16ae tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 404 len: 111 microversion: 2.20 time: 0.032315 Sep 13 10:23:20.188039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 480/957] 10.222.0.62 () {60 vars in 1280 bytes} [Tue Sep 13 10:23:20 2022] DELETE /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:20.193114 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:20.194321 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: a9a6c608-489a-41f5-b4ff-8c2a248af808] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:20.201301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.201782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.202247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.203137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.203649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.204073 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.217823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 HTTP/1.1 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:20.220183 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.221516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'a9a6c608-489a-41f5-b4ff-8c2a248af808'} Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:20.222241 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. Sep 13 10:23:20.223475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:20.224633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance a9a6c608-489a-41f5-b4ff-8c2a248af808 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:20.224633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d631206e-43d1-422c-82ca-526c04191c9e tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808" status: 404 len: 111 microversion: 2.20 time: 0.033199 Sep 13 10:23:20.224633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 478/958] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:20 2022] GET /compute/v2.1/servers/a9a6c608-489a-41f5-b4ff-8c2a248af808 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:20.756021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:20.758137 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:20.763970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.764441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.764864 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.765537 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.766513 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.766949 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.796933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fb53707e-7897-4e8e-927b-2c1a5dee6f26 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044824 Sep 13 10:23:20.797530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 481/959] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:23:20 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:23:20.914358 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:20.916650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:20.922822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.923342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.923782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.924475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:20.924929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:20.925351 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:20.957041 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5f5df528-5dce-4e19-8115-b87508150fd3 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047041 Sep 13 10:23:20.957600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 479/960] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:23:20 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 10:23:21.025103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:21.025569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:21.032399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.036935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.036935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.036935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.036935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.037287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.063215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:23:21.404615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-609ab090-65b1-43cd-b935-fa3fb330f620 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 204 len: 0 microversion: 2.1 time: 0.383167 Sep 13 10:23:21.405287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 482/961] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:23:21 2022] DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:23:21.413786 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:21.414397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:21.420790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.421274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.421706 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.422884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.423395 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.423824 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.560352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:21.568627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-26a1e614-41cc-4695-a405-92cf3d19e009 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1674 microversion: 2.1 time: 0.158744 Sep 13 10:23:21.569189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 480/962] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:21 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:23:21.743007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:21.743650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:21.749496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.749974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.755016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.755016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.755016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.755016 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.765152 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac HTTP/1.1 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:21.766806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.768506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '43a5958c-f83f-4303-bd83-8078154da9ac'} Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:21.769404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.770882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.772352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:21.772352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a72db276-ad30-4653-ba60-4783a4b71fcd tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 404 len: 111 microversion: 2.20 time: 0.029527 Sep 13 10:23:21.772352 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 483/963] 10.222.0.62 () {60 vars in 1280 bytes} [Tue Sep 13 10:23:21 2022] DELETE /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:21.776899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:21.777509 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] [instance: 43a5958c-f83f-4303-bd83-8078154da9ac] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:21.784036 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.784551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.784992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.785714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:21.786169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:21.786590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:21.800333 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] HTTP exception thrown: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Request method failure captured: Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac HTTP/1.1 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFhVxTgIHGipmy8aPWaBocD386IazrSjznbiC9_rky9NXp2C7bXcwouVpfESmEEHGAYgn5BDi6QxRGVg_8dWYSuY_zjBuHRnh1jvLczD75SgdvsxvU6JDvjv0xIF5eeDX41gAJC5wt4yjgRSN-ZWBjQEOFo3Qz7AadLRokZrjTX6abQ Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:21.801983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b45075d7ec024b3a907d11225942fbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b45075d7ec024b3a907d11225942fbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: b45075d7ec024b3a907d11225942fbee Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-861938864 Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: c069999293a847cdb11650045e22576c Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeShelveTestJSON-861938864-project Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.803659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '43a5958c-f83f-4303-bd83-8078154da9ac'} Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:21.804739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. Sep 13 10:23:21.806170 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:21.812817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] Returning 404 to user: Instance 43a5958c-f83f-4303-bd83-8078154da9ac could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:21.812817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-49be52ad-b5eb-4222-96f4-07c8a66f9e0b tempest-AttachVolumeShelveTestJSON-861938864 tempest-AttachVolumeShelveTestJSON-861938864-project] 10.222.0.62 "GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac" status: 404 len: 111 microversion: 2.20 time: 0.030674 Sep 13 10:23:21.812817 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 481/964] 10.222.0.62 () {60 vars in 1277 bytes} [Tue Sep 13 10:23:21 2022] GET /compute/v2.1/servers/43a5958c-f83f-4303-bd83-8078154da9ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 10:23:22.591420 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:22.592056 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:22.599025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:22.599534 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:22.599961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:22.600650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:22.601103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:22.601520 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:22.749858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:22.760034 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f4dc85fd-ccc7-4f09-8378-0f7322f32894 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1674 microversion: 2.1 time: 0.171933 Sep 13 10:23:22.761081 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 484/965] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:22 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:23:23.795300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:23.796740 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:23.805256 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:23.806413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:23.807092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:23.813454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:23.813454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:23.813454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:24.082403 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:24.096770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d035a098-075a-4ea8-8034-11b623698a53 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1674 microversion: 2.1 time: 0.305698 Sep 13 10:23:24.098061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 482/966] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:23 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1674 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:23:24.431612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9caab-c36d-43c3-b09a-362716549fce", "name": "network-vif-deleted", "tag": "6a9e22f8-803d-4cec-b60d-b75dbadaf04e"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:24.441326 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:24.442233 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:24.442846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:24.457841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] Creating event network-vif-deleted:6a9e22f8-803d-4cec-b60d-b75dbadaf04e for instance a6d9caab-c36d-43c3-b09a-362716549fce on hv-cinder-85427 Sep 13 10:23:24.463767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-99683170-cfc3-4ffe-a5fd-cff68e09535d req-0631be0b-2ff4-4919-9429-cc4d737530af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Sep 13 10:23:24.465174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 485/967] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:25.128947 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:25.129595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:25.143137 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:25.143727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:25.144166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:25.144882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:25.145335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:25.145760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:25.169644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:25.190726 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:25.191355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:25.191805 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:25.192266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lazy-loading 'fault' on Instance uuid a6d9caab-c36d-43c3-b09a-362716549fce {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:23:25.253361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90f07b101240464387f3fbf92c925ec7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aaa16702a5422b90578033420da9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:23:25.263794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5e38eb8e-0b6d-4403-8ba5-bcd241406d05 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 200 len: 1327 microversion: 2.1 time: 0.145376 Sep 13 10:23:25.265223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 483/968] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:25 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:23:26.288946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:26.298039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:26.301320 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:26.301772 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:26.302361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:26.303142 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:26.303845 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:26.304110 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:26.321302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce HTTP/1.1 Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:26.324428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:26.326475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a6d9caab-c36d-43c3-b09a-362716549fce'} Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:26.327417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:26.329678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:26.331107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:26.331107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-db5012eb-7b3c-4e8f-9d77-709bddba880c tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 404 len: 111 microversion: 2.1 time: 0.040258 Sep 13 10:23:26.331107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 486/969] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:26 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:26.333989 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e3f29463-63bc-4f07-93f0-6d2314c4babc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '.version_select at 0x7f46c12a51f0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:26.462448 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e3f29463-63bc-4f07-93f0-6d2314c4babc tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204844795" status: 202 len: 0 microversion: 2.1 time: 0.132272 Sep 13 10:23:26.463630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 484/970] 10.222.0.62 () {58 vars in 1218 bytes} [Tue Sep 13 10:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204844795 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:28.221265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c44d5069-04ec-429b-be5c-44a02aaca388 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Action: 'create', calling method: .version_select at 0x7f46c487b160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-902555279", "metadata": {"Type": "work"}}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:28.865023 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c44d5069-04ec-429b-be5c-44a02aaca388 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.760459 Sep 13 10:23:28.865646 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 487/971] 10.222.0.62 () {60 vars in 1156 bytes} [Tue Sep 13 10:23:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 762 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 10:23:28.879253 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b18000d9-8815-4451-959a-dd4b6fd525d6 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c10da940>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:28.931322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b18000d9-8815-4451-959a-dd4b6fd525d6 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 200 len: 352 microversion: 2.1 time: 0.056397 Sep 13 10:23:28.932009 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 485/972] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:28 2022] GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:23:29.807268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:29.807747 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:29.815097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:29.818274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:29.818274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:29.818274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:29.818274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:29.818625 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:29.831767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce HTTP/1.1 Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:29.833297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.834876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a6d9caab-c36d-43c3-b09a-362716549fce'} Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:29.835816 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.837285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.838880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:29.838880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e502795a-0619-4bc2-8eba-bcdae0585606 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 404 len: 111 microversion: 2.1 time: 0.031722 Sep 13 10:23:29.838880 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 488/973] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:23:29 2022] DELETE /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:29.843273 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:29.843890 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: a6d9caab-c36d-43c3-b09a-362716549fce] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:29.851235 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:29.851715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:29.852152 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:29.852959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:29.853411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:29.853834 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:29.866981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce HTTP/1.1 Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:29.868532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.870160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'a6d9caab-c36d-43c3-b09a-362716549fce'} Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:29.874281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. Sep 13 10:23:29.886931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:29.888996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance a6d9caab-c36d-43c3-b09a-362716549fce could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:29.888996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-28224bda-e417-49ce-ad3f-158dbbfab856 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce" status: 404 len: 111 microversion: 2.1 time: 0.030532 Sep 13 10:23:29.888996 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 486/974] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:29 2022] GET /compute/v2.1/servers/a6d9caab-c36d-43c3-b09a-362716549fce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:29.945896 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-99fb0b66-43ec-4e60-aefb-6455d6f68c8f tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c487b1f0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:29.994082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-99fb0b66-43ec-4e60-aefb-6455d6f68c8f tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 200 len: 353 microversion: 2.1 time: 0.051670 Sep 13 10:23:29.994340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 489/975] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:29 2022] GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:23:30.007566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-71929c7f-7a9e-4169-b77e-79a112ddea4b tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c10e88b0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:30.054840 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-71929c7f-7a9e-4169-b77e-79a112ddea4b tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 200 len: 353 microversion: 2.1 time: 0.051004 Sep 13 10:23:30.055436 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 487/976] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:30 2022] GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:30.073539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-75277f4b-521a-43d8-b8b2-de4ca23ef8ed tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c48de9d0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:30.283021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-75277f4b-521a-43d8-b8b2-de4ca23ef8ed tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 202 len: 0 microversion: 2.1 time: 0.213245 Sep 13 10:23:30.283738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 490/977] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:23:30 2022] DELETE /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:30.292088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-573dc0dd-21c7-47ab-a5bf-e03818e2dc75 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c13f53a0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:30.339847 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-573dc0dd-21c7-47ab-a5bf-e03818e2dc75 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 200 len: 352 microversion: 2.1 time: 0.051829 Sep 13 10:23:30.340413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 488/978] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:30 2022] GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:31.164135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:31.164901 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:31.172074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:31.172619 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:31.173134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:31.173954 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:31.174509 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:31.175001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:31.189810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 HTTP/1.1 Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:31.191399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.193087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '0d6ac518-daa6-4685-91e9-db203b8dafe4'} Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:31.193943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.195457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.197296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:31.197296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6654ffdf-b609-45bd-837a-50c04c115984 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 404 len: 111 microversion: 2.1 time: 0.033654 Sep 13 10:23:31.197296 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 491/979] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:23:31 2022] DELETE /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:31.205513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:31.206199 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] [instance: 0d6ac518-daa6-4685-91e9-db203b8dafe4] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:23:31.212141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:31.217461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:31.217461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:31.217461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:23:31.217461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:23:31.217939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:23:31.228527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] HTTP exception thrown: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Request method failure captured: Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 HTTP/1.1 Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFilnEy3in7xvsFFXzC-7KdSZZP_0yke5sE-0lvLxKiyVMWDhw24cH4vlFu_1v9scjNQ7lQw6_sCkfQRbxO5U2vj2hqfCU1zU17Sl_jDMsRnVAro3FLGLazOprlWftOF9p8nHpbJpelnVAZwoufppFY8IySCrqq2oyTpJMEoZIdygjg Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:31.230053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9aaa16702a5422b90578033420da9bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9aaa16702a5422b90578033420da9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: c9aaa16702a5422b90578033420da9bd Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1122685507 Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 90f07b101240464387f3fbf92c925ec7 Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-AttachVolumeTestJSON-1122685507-project Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.231669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '0d6ac518-daa6-4685-91e9-db203b8dafe4'} Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:31.232511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. Sep 13 10:23:31.234109 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.239551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] Returning 404 to user: Instance 0d6ac518-daa6-4685-91e9-db203b8dafe4 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:31.239551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e5181e4a-ab27-44b4-869b-5ed00aa27929 tempest-AttachVolumeTestJSON-1122685507 tempest-AttachVolumeTestJSON-1122685507-project] 10.222.0.62 "GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4" status: 404 len: 111 microversion: 2.1 time: 0.033337 Sep 13 10:23:31.239551 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 489/980] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:23:31 2022] GET /compute/v2.1/servers/0d6ac518-daa6-4685-91e9-db203b8dafe4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:31.355514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b1db0e25-c940-43a6-b7ea-3bf46b353059 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Calling method '.version_select at 0x7f46c48411f0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:31.400663 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-b1db0e25-c940-43a6-b7ea-3bf46b353059 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] HTTP exception thrown: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b1db0e25-c940-43a6-b7ea-3bf46b353059 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Request method failure captured: Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 HTTP/1.1 Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFogL6BZXIMce5j_QX9nYMDk6dp4TsnTppgyTRIiQ2AIIuEHEb9qDEnJqLx2Z7_BCqc3Lrv5K-OAgY4VMSNBQHjFzmo9vW0WTxDnI61hvKQidhsDspGaEW43k0VULTmigVmcp4W5JNNVyFR5rD84dr2V4W90iFOlsiDpKiB-ohGUVZY Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 4436a7e677ac44f0bcc8f03b18c3d0ed Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesGetTestJSON-51168791 Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:31.404649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4436a7e677ac44f0bcc8f03b18c3d0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4436a7e677ac44f0bcc8f03b18c3d0ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4436a7e677ac44f0bcc8f03b18c3d0ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4436a7e677ac44f0bcc8f03b18c3d0ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesGetTestJSON-51168791 Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 4436a7e677ac44f0bcc8f03b18c3d0ed Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesGetTestJSON-51168791 Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesGetTestJSON-51168791-project Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 5746696d7afd4f17a3bda34cd2f42838 Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesGetTestJSON-51168791-project Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '593e7564-d84e-4d34-9ecd-3244c1641565'} Sep 13 10:23:31.406367 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. (HTTP 404) (Request-ID: req-d567efcb-2846-4e4c-9855-63296312813c) Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.407436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:31.409557 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 10:23:31.411692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. Sep 13 10:23:31.414109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:31.419003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b1db0e25-c940-43a6-b7ea-3bf46b353059 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] Returning 404 to user: Volume 593e7564-d84e-4d34-9ecd-3244c1641565 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:31.420177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b1db0e25-c940-43a6-b7ea-3bf46b353059 tempest-VolumesGetTestJSON-51168791 tempest-VolumesGetTestJSON-51168791-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565" status: 404 len: 109 microversion: 2.1 time: 0.068896 Sep 13 10:23:31.421263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 492/981] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:31 2022] GET /compute/v2.1/os-volumes/593e7564-d84e-4d34-9ecd-3244c1641565 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:37.563038 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-42636a45-7933-48a1-8281-fc93a88dee6f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Action: 'create', calling method: .version_select at 0x7f46c1c488b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1325431713"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:38.291213 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-42636a45-7933-48a1-8281-fc93a88dee6f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.842669 Sep 13 10:23:38.291846 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 490/982] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Sep 13 10:23:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 844 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 10:23:38.305618 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fb0dd0c3-fb55-484a-9c55-8f983b282d98 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c1007d30>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:38.354518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fb0dd0c3-fb55-484a-9c55-8f983b282d98 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 200 len: 345 microversion: 2.1 time: 0.053230 Sep 13 10:23:38.355081 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 493/983] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:38 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:39.369754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7f97b697-ccf5-446a-8e68-4791fe941c99 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c10333a0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:39.417593 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7f97b697-ccf5-446a-8e68-4791fe941c99 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 200 len: 345 microversion: 2.1 time: 0.052248 Sep 13 10:23:39.418149 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 491/984] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:39 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:40.433391 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-796adc21-3bcc-4836-a6d4-68699573b855 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c484b8b0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:40.480456 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-796adc21-3bcc-4836-a6d4-68699573b855 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 200 len: 346 microversion: 2.1 time: 0.052255 Sep 13 10:23:40.481160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 494/985] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:40 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:40.494776 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-14914b5b-a6af-40f1-91c4-6833aa18ed83 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Action: 'create', calling method: .version_select at 0x7f46c130c670>, body: {"snapshot": {"volume_id": "ca4ebbcd-094c-4688-8e12-651c71b7a22b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-498171185"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:40.909615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-14914b5b-a6af-40f1-91c4-6833aa18ed83 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.419005 Sep 13 10:23:40.916716 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 492/986] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Sep 13 10:23:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:40.921263 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-22f07128-950a-4848-b36c-77d8f941ab1e tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c4841ee0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:41.095666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-22f07128-950a-4848-b36c-77d8f941ab1e tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.176752 Sep 13 10:23:41.095666 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 495/987] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:40 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:41.106536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-08a8f8d1-3ef6-4a3b-91ac-ee9a600ec11a tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c1e4dca0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:41.209371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:41.219515 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=8 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:41.368659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-08a8f8d1-3ef6-4a3b-91ac-ee9a600ec11a tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.266210 Sep 13 10:23:41.369225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 493/988] 10.222.0.62 () {58 vars in 1140 bytes} [Tue Sep 13 10:23:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:41.381257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6e2c182d-770e-4784-a8a7-0e2f0da7084b tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c480e310>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:41.391796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:41.393005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:23:41.440216 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6e2c182d-770e-4784-a8a7-0e2f0da7084b tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.062968 Sep 13 10:23:41.440878 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 496/989] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:41 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:42.454473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e1155d41-2d81-43f1-b15a-d6c6b46a135b tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c1e4ddc0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:42.486092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e1155d41-2d81-43f1-b15a-d6c6b46a135b tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.036714 Sep 13 10:23:42.486738 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 494/990] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:42 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:43.499097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0a8fa313-604c-44e6-b9e2-a31d01012bc6 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c484bf70>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:43.528939 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0a8fa313-604c-44e6-b9e2-a31d01012bc6 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.033895 Sep 13 10:23:43.529370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 497/991] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:43 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:44.542195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1e47cf2-13c0-4436-8c39-197a7c85a44f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c13f5310>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:44.572882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a1e47cf2-13c0-4436-8c39-197a7c85a44f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 287 microversion: 2.1 time: 0.034829 Sep 13 10:23:44.573538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 495/992] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:44 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:44.585309 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-954174bd-8427-4922-b8af-91b848b8db75 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c4859040>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:44.689842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-954174bd-8427-4922-b8af-91b848b8db75 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 202 len: 0 microversion: 2.1 time: 0.108755 Sep 13 10:23:44.690436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 498/993] 10.222.0.62 () {58 vars in 1254 bytes} [Tue Sep 13 10:23:44 2022] DELETE /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:44.698661 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f59907a4-23d1-46e5-b69f-5a2554d81ba2 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c130c040>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:44.728724 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f59907a4-23d1-46e5-b69f-5a2554d81ba2 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.033893 Sep 13 10:23:44.729324 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 496/994] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:44 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:45.742236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-013c6b5b-66b4-4535-95c6-4d0659182cc3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c482ec10>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:45.773833 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-013c6b5b-66b4-4535-95c6-4d0659182cc3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.035766 Sep 13 10:23:45.774394 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 499/995] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:45 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:46.787978 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-473fc293-3582-4d8e-bb38-7a7d5db05259 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c13f5ca0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:46.818326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-473fc293-3582-4d8e-bb38-7a7d5db05259 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 200 len: 286 microversion: 2.1 time: 0.034451 Sep 13 10:23:46.818943 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 497/996] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:46 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:47.832339 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aff6e6fb-214c-4a19-b13e-c617ac9d6acc tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c4859b80>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:47.917944 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-aff6e6fb-214c-4a19-b13e-c617ac9d6acc tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] HTTP exception thrown: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aff6e6fb-214c-4a19-b13e-c617ac9d6acc tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Request method failure captured: Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b HTTP/1.1 Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFopOYGrdxyVNj5l7oIDoqlJhaZn3JKv0ocVkqTkyjMTC1OCpkrY3DEQhZjDXHA79gIjGK9g8D2zle0esSpeJVTqaM6pUmSJhA6G6pjTtD_BjDMjaRQP71dwOiYAW3bX-yAKZipxjvRx0R4p5VgwFgR-G2xlfpE7RT17bRRddZ7EhmA Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:47.920243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 509a923e45854118955f7b9925463ca2 Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '4f17fb3f-b974-4338-a7b3-1c6df19ecf8b'} Sep 13 10:23:47.921869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. (HTTP 404) (Request-ID: req-73cffeef-9fa6-4820-a91c-43b6d709cf6b) Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.923059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:47.927620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 10:23:47.929570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-aff6e6fb-214c-4a19-b13e-c617ac9d6acc tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Returning 404 to user: Snapshot 4f17fb3f-b974-4338-a7b3-1c6df19ecf8b could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:47.931726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-aff6e6fb-214c-4a19-b13e-c617ac9d6acc tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b" status: 404 len: 111 microversion: 2.1 time: 0.094384 Sep 13 10:23:47.933007 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 500/997] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:23:47 2022] GET /compute/v2.1/os-snapshots/4f17fb3f-b974-4338-a7b3-1c6df19ecf8b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:47.938950 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-dc85ad30-a8b4-4658-8ebb-81e0cbf628b7 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c10e7e50>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:48.193139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-dc85ad30-a8b4-4658-8ebb-81e0cbf628b7 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 202 len: 0 microversion: 2.1 time: 0.261162 Sep 13 10:23:48.193715 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 498/998] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:23:47 2022] DELETE /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:23:48.201860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5d65ecec-ed25-42b2-9864-160a3c2e722f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c480ef70>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:48.250024 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5d65ecec-ed25-42b2-9864-160a3c2e722f tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 200 len: 345 microversion: 2.1 time: 0.051812 Sep 13 10:23:48.250586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 501/999] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:48 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:23:49.266826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-24277aba-118e-427b-8829-bfb7fdce33b3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c12a5820>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:49.296541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-24277aba-118e-427b-8829-bfb7fdce33b3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] HTTP exception thrown: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-24277aba-118e-427b-8829-bfb7fdce33b3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Request method failure captured: Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b HTTP/1.1 Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFopOYGrdxyVNj5l7oIDoqlJhaZn3JKv0ocVkqTkyjMTC1OCpkrY3DEQhZjDXHA79gIjGK9g8D2zle0esSpeJVTqaM6pUmSJhA6G6pjTtD_BjDMjaRQP71dwOiYAW3bX-yAKZipxjvRx0R4p5VgwFgR-G2xlfpE7RT17bRRddZ7EhmA Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:49.299780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 509a923e45854118955f7b9925463ca2 Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'ca4ebbcd-094c-4688-8e12-651c71b7a22b'} Sep 13 10:23:49.301370 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. (HTTP 404) (Request-ID: req-4490a3c5-3a6f-4f5e-970e-fe54bd49065f) Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.302459 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:49.303897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 10:23:49.305097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-24277aba-118e-427b-8829-bfb7fdce33b3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Returning 404 to user: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-24277aba-118e-427b-8829-bfb7fdce33b3 tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 404 len: 109 microversion: 2.1 time: 0.039188 Sep 13 10:23:49.306742 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 499/1000] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:49 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:49.311963 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8a9f937b-415a-4095-99e1-16aa2df6baac tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c484b8b0>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:49.340154 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-8a9f937b-415a-4095-99e1-16aa2df6baac tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] HTTP exception thrown: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8a9f937b-415a-4095-99e1-16aa2df6baac tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Request method failure captured: Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b HTTP/1.1 Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFopOYGrdxyVNj5l7oIDoqlJhaZn3JKv0ocVkqTkyjMTC1OCpkrY3DEQhZjDXHA79gIjGK9g8D2zle0esSpeJVTqaM6pUmSJhA6G6pjTtD_BjDMjaRQP71dwOiYAW3bX-yAKZipxjvRx0R4p5VgwFgR-G2xlfpE7RT17bRRddZ7EhmA Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:49.342241 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 509a923e45854118955f7b9925463ca2 Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'ca4ebbcd-094c-4688-8e12-651c71b7a22b'} Sep 13 10:23:49.343905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. (HTTP 404) (Request-ID: req-64d526d2-bf58-477e-8132-21c09cd79e72) Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.344858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:49.346256 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 10:23:49.347593 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8a9f937b-415a-4095-99e1-16aa2df6baac tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Returning 404 to user: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:49.349040 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8a9f937b-415a-4095-99e1-16aa2df6baac tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 404 len: 109 microversion: 2.1 time: 0.036658 Sep 13 10:23:49.350046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 502/1001] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:23:49 2022] DELETE /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:49.352189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-99f03c63-f8ac-44a1-9903-11eebfd902be tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Calling method '.version_select at 0x7f46c10dadc0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:49.379775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-99f03c63-f8ac-44a1-9903-11eebfd902be tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] HTTP exception thrown: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-99f03c63-f8ac-44a1-9903-11eebfd902be tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Request method failure captured: Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b HTTP/1.1 Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFopOYGrdxyVNj5l7oIDoqlJhaZn3JKv0ocVkqTkyjMTC1OCpkrY3DEQhZjDXHA79gIjGK9g8D2zle0esSpeJVTqaM6pUmSJhA6G6pjTtD_BjDMjaRQP71dwOiYAW3bX-yAKZipxjvRx0R4p5VgwFgR-G2xlfpE7RT17bRRddZ7EhmA Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:49.382244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/eec6632f73df41f0b93ab6cb261c19fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: eec6632f73df41f0b93ab6cb261c19fc Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1847915656 Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 509a923e45854118955f7b9925463ca2 Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1847915656-project Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'ca4ebbcd-094c-4688-8e12-651c71b7a22b'} Sep 13 10:23:49.383885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. (HTTP 404) (Request-ID: req-e44d7abf-d715-4f2c-bec2-7c32f47965e7) Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.384931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:49.386339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 10:23:49.390320 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-99f03c63-f8ac-44a1-9903-11eebfd902be tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] Returning 404 to user: Volume ca4ebbcd-094c-4688-8e12-651c71b7a22b could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-99f03c63-f8ac-44a1-9903-11eebfd902be tempest-VolumesSnapshotsTestJSON-1847915656 tempest-VolumesSnapshotsTestJSON-1847915656-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b" status: 404 len: 109 microversion: 2.1 time: 0.034728 Sep 13 10:23:49.391995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 500/1002] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:49 2022] GET /compute/v2.1/os-volumes/ca4ebbcd-094c-4688-8e12-651c71b7a22b => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:51.744335 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-95d175e8-d32f-4f86-b4cc-b402de3576ee tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Action: 'create', calling method: .version_select at 0x7f46c10e4b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1080539442", "metadata": {"Type": "work"}}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-95d175e8-d32f-4f86-b4cc-b402de3576ee tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 122 Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:51.754866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1080539442", "metadata": {"Type": "work"}}} Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:51.756575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1080539442', 'metadata': {'Type': 'work'}}}} Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise error Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.757633 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 10:23:51.759269 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 10:23:51.760665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 10:23:51.760665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.760665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-95d175e8-d32f-4f86-b4cc-b402de3576ee tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.760665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-95d175e8-d32f-4f86-b4cc-b402de3576ee tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.269699 Sep 13 10:23:51.760665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 503/1003] 10.222.0.62 () {60 vars in 1156 bytes} [Tue Sep 13 10:23:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:51.767658 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-799c08ba-8abe-4cb2-be6f-5cb8073d541f tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Action: 'create', calling method: .version_select at 0x7f46c10e8670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1267327295", "metadata": {"Type": "work"}}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-799c08ba-8abe-4cb2-be6f-5cb8073d541f tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 120 Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:51.772264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1267327295", "metadata": {"Type": "work"}}} Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: Sep 13 10:23:51.773910 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1267327295', 'metadata': {'Type': 'work'}}}} Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise error Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi '0' Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.775013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 10:23:51.776884 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 10:23:51.778371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 10:23:51.778371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.778371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-799c08ba-8abe-4cb2-be6f-5cb8073d541f tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.778371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-799c08ba-8abe-4cb2-be6f-5cb8073d541f tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011080 Sep 13 10:23:51.778371 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 501/1004] 10.222.0.62 () {60 vars in 1156 bytes} [Tue Sep 13 10:23:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:51.783992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2667dc1c-8b17-415d-b8d3-7bcb52383507 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Action: 'create', calling method: .version_select at 0x7f46c47890d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-130528620", "metadata": {"Type": "work"}}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2667dc1c-8b17-415d-b8d3-7bcb52383507 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 118 Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:51.787627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-130528620", "metadata": {"Type": "work"}}} Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:51.789174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-130528620', 'metadata': {'Type': 'work'}}}} Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise error Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi '' Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.790245 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 10:23:51.791966 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 10:23:51.793628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 10:23:51.793628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.793628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2667dc1c-8b17-415d-b8d3-7bcb52383507 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.793628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2667dc1c-8b17-415d-b8d3-7bcb52383507 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009461 Sep 13 10:23:51.793628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 504/1005] 10.222.0.62 () {60 vars in 1156 bytes} [Tue Sep 13 10:23:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 10:23:51.798420 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-38f9e29e-47c4-49bb-92e9-b4d948885093 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Calling method '.version_select at 0x7f46c117ddc0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:51.825772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-38f9e29e-47c4-49bb-92e9-b4d948885093 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] HTTP exception thrown: Volume tempest-invalid-841771830 could not be found. Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-38f9e29e-47c4-49bb-92e9-b4d948885093 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-841771830 HTTP/1.1 Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:51.827747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Volume tempest-invalid-841771830 could not be found. Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'tempest-invalid-841771830'} Sep 13 10:23:51.829357 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-841771830 could not be found. (HTTP 404) (Request-ID: req-955d9ee7-e660-416c-a6d2-b4b5ff8bea91) Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.830396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:51.831868 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-841771830 could not be found. Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:51.834087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-841771830 could not be found. Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-841771830 could not be found. Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-38f9e29e-47c4-49bb-92e9-b4d948885093 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 404 to user: Volume tempest-invalid-841771830 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-38f9e29e-47c4-49bb-92e9-b4d948885093 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-841771830" status: 404 len: 98 microversion: 2.1 time: 0.035011 Sep 13 10:23:51.835610 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 502/1006] 10.222.0.62 () {58 vars in 1215 bytes} [Tue Sep 13 10:23:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-841771830 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 10:23:51.839360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8ef5d435-69d8-4b97-9dca-30cc6c1fb656 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004569 Sep 13 10:23:51.839860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 505/1007] 10.222.0.62 () {58 vars in 1140 bytes} [Tue Sep 13 10:23:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 10:23:51.851412 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-faa295b6-5412-4ba5-8472-c508e0f59a42 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004213 Sep 13 10:23:51.852784 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 503/1008] 10.222.0.62 () {58 vars in 1137 bytes} [Tue Sep 13 10:23:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 10:23:51.869581 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a5985a4-6ca2-4238-bb8b-d4c6b261c3db tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Calling method '.version_select at 0x7f46c4825550>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:51.896769 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-3a5985a4-6ca2-4238-bb8b-d4c6b261c3db tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] HTTP exception thrown: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a5985a4-6ca2-4238-bb8b-d4c6b261c3db tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/os-volumes/ae25610e-c95e-41c2-b301-aa69dd65dd4a HTTP/1.1 Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:23:51.898732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'ae25610e-c95e-41c2-b301-aa69dd65dd4a'} Sep 13 10:23:51.900323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. (HTTP 404) (Request-ID: req-5351ed8f-1855-4c36-ad7b-6acf044fce5d) Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.901447 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 10:23:51.902591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 10:23:51.903794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a5985a4-6ca2-4238-bb8b-d4c6b261c3db tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 404 to user: Volume ae25610e-c95e-41c2-b301-aa69dd65dd4a could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3a5985a4-6ca2-4238-bb8b-d4c6b261c3db tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/ae25610e-c95e-41c2-b301-aa69dd65dd4a" status: 404 len: 109 microversion: 2.1 time: 0.034337 Sep 13 10:23:51.905514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 506/1009] 10.222.0.62 () {58 vars in 1248 bytes} [Tue Sep 13 10:23:51 2022] DELETE /compute/v2.1/os-volumes/ae25610e-c95e-41c2-b301-aa69dd65dd4a => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:51.912608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-41524989-dc95-402b-bd75-f59a83fcccc6 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Calling method '.version_select at 0x7f46c10e2af0>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:23:51.940601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-41524989-dc95-402b-bd75-f59a83fcccc6 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] HTTP exception thrown: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-41524989-dc95-402b-bd75-f59a83fcccc6 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Request method failure captured: Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/os-volumes/90ef4f67-9cf1-44ee-8ae6-5d4713468161 HTTP/1.1 Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFo35mSW6Vhglv17SnCoHGnvAuGjqxpH2OQGJJNTjlIXVzXeuD9W1wAJDFamKPnlgtBqSS3yLaiv0hz9kUFUPbm1LQ9dgnorNfrx7RFDwWkyaw55xBzUp9Fe5aahA22AdYxLXIUUQGtgRwLGvlyrngv_B5MvIMDWen6de2HqZJdHIxY Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:23:51.942636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b7a936ec9cc4ee69ab4159ad5b0e7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 2b7a936ec9cc4ee69ab4159ad5b0e7df Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesNegativeTest-1185453424 Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 9873d40ae2b147b1ae1ec1aab2edf85e Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesNegativeTest-1185453424-project Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '90ef4f67-9cf1-44ee-8ae6-5d4713468161'} Sep 13 10:23:51.944958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. (HTTP 404) (Request-ID: req-d1591c71-28e9-4aa3-8d66-f321d5716b76) Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.946417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 10:23:51.947882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 10:23:51.949201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-41524989-dc95-402b-bd75-f59a83fcccc6 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] Returning 404 to user: Volume 90ef4f67-9cf1-44ee-8ae6-5d4713468161 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:23:51.950601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-41524989-dc95-402b-bd75-f59a83fcccc6 tempest-VolumesNegativeTest-1185453424 tempest-VolumesNegativeTest-1185453424-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90ef4f67-9cf1-44ee-8ae6-5d4713468161" status: 404 len: 109 microversion: 2.1 time: 0.036980 Sep 13 10:23:51.951685 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 504/1010] 10.222.0.62 () {58 vars in 1245 bytes} [Tue Sep 13 10:23:51 2022] GET /compute/v2.1/os-volumes/90ef4f67-9cf1-44ee-8ae6-5d4713468161 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:23:59.599712 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-3759576", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "networks": [{"uuid": "8d49a057-6bd8-4080-b93e-159c540d819c"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:23:59.652739 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] validate_networks() for [('8d49a057-6bd8-4080-b93e-159c540d819c', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:24:00.017033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:24:00.017543 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:24:00.018095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:24:00.018501 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:24:00.018913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:24:00.028916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:00.034956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:00.034956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:00.034956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:00.034956 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:00.035516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:00.051775 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Getting quotas for project 8879b3720c0d482d8118a0d2e5590b54. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:24:00.056147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Getting quotas for user 9a6e7e1e625247a3963aa8a0a29eb478 and project 8879b3720c0d482d8118a0d2e5590b54. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:24:00.067609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:24:00.069942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:24:00.189700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR oslo.messaging._drivers.impl_rabbit [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [6d6bb51e-e8e5-4281-a987-e1a3f3008436] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 10:24:01.196888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO oslo.messaging._drivers.impl_rabbit [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [6d6bb51e-e8e5-4281-a987-e1a3f3008436] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38682. Sep 13 10:24:01.201046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-af5fa519-927a-49b9-92b0-1265ee1e4ed7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605881 Sep 13 10:24:01.202063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 507/1011] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:24:01.214021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-40244c60-e19b-4da9-b81a-f19395110862 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:01.214628 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-40244c60-e19b-4da9-b81a-f19395110862 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:01.275374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-40244c60-e19b-4da9-b81a-f19395110862 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:01.282779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-40244c60-e19b-4da9-b81a-f19395110862 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1216 microversion: 2.1 time: 0.073317 Sep 13 10:24:01.285089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 505/1012] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:01 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:02.306564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:02.307230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:02.314242 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:02.314716 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:02.318579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:02.318579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:02.318579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:02.318579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:02.377298 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:02.384968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c2fdc49a-f72a-4684-a2cf-cb9ac66d5945 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1220 microversion: 2.1 time: 0.082758 Sep 13 10:24:02.385556 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 508/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:02 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:03.408918 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:03.409602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:03.416390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:03.418453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:03.418453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:03.418453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:03.418453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:03.418881 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:03.493821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:03.501811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2d6b0808-bb61-4843-8fc5-5f29b7824220 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1220 microversion: 2.1 time: 0.097544 Sep 13 10:24:03.502399 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 506/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:03 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:03.651605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:03.652177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:03.653468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:03.661867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:03.662670 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:03.663378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:03.663637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:03.664197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:03.664751 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:03.665297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:03.665923 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:03.666550 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:03.676585 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] Creating event network-changed:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:24:03.681722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-d87eb207-6f82-4a95-b1c1-5fe11149fe94 req-86da7e27-f3c1-4d95-942b-3d5a17f16efd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034327 Sep 13 10:24:03.682667 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 507/1015] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:03.699558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:24:04.124725 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-43e8b3e5-c4c0-49df-a3ba-20491d660676 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 204 len: 0 microversion: 2.1 time: 0.477141 Sep 13 10:24:04.125890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 509/1016] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:24:03 2022] DELETE /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:24:04.136540 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:04.137274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:04.143889 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:04.144381 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:04.144821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:04.145545 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:04.145999 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:04.146424 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:04.286348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:04.298866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2c3a9133-8fe8-42ad-a32c-f30d386f8f97 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.161916 Sep 13 10:24:04.298866 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 508/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:04 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:04.525397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:04.526334 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:04.532979 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:04.533436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:04.533860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:04.534547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:04.534999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:04.535577 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:04.601377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:04.612461 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ceadaa8a-4a30-407e-927b-a722a6312026 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1212 microversion: 2.1 time: 0.091033 Sep 13 10:24:04.628113 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 510/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:04 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:05.317777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:05.318394 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:05.325101 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:05.325592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:05.326034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:05.326733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:05.327217 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:05.327647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:05.461070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:05.469522 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a34c5880-bb95-4f1f-9d3e-f296dc1727e1 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.155585 Sep 13 10:24:05.470260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 509/1019] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:05 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:05.634397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:05.635068 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:05.642351 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:05.642830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:05.643470 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:05.644207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:05.644608 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:05.645027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:05.705942 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:05.713568 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b2d7551d-804b-4833-a11d-a8787a296b56 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1212 microversion: 2.1 time: 0.082936 Sep 13 10:24:05.714123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 511/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:05 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:06.493780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:06.494367 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:06.501536 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:06.502014 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:06.502446 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:06.503124 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:06.503601 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:06.504022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:06.633618 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:06.641609 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d744fbeb-4ae1-48e4-a574-84d434d01254 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.151843 Sep 13 10:24:06.642182 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 510/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:06 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:06.736732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:06.740734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:06.743483 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:06.743975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:06.744407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:06.745273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:06.745894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:06.746482 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:06.817177 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:06.827711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1d3cee3d-8bae-4f64-afc3-c8a3f2e19292 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1268 microversion: 2.1 time: 0.093005 Sep 13 10:24:06.827711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 512/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:06 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1268 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:07.665717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:07.668527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:07.673438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:07.673928 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:07.674562 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:07.675518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:07.675975 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:07.676407 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:07.849105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:07.849841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:07.856872 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:07.857496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:07.857938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:07.858711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:07.859197 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:07.859651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:08.001191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:08.007274 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-523f3b21-8ffc-4533-82d9-3e2ad59bac4f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1268 microversion: 2.1 time: 0.162065 Sep 13 10:24:08.008074 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 513/1023] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:07 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:08.130516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:08.138126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-91eaa6fa-6620-4914-9de2-a421bb323451 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1569 microversion: 2.1 time: 0.476680 Sep 13 10:24:08.138696 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 511/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:07 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1569 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:09.031974 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:09.033215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:09.041811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:09.042883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:09.043438 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:09.045890 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:09.046612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:09.047145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:09.075625 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e3aa48-e46d-4063-bec2-139465c7b571", "name": "network-vif-deleted", "tag": "b6ce30f4-9d3d-45cc-8f3c-567181f59486"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:09.087040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:09.087574 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:09.088011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:09.099340 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] Creating event network-vif-deleted:b6ce30f4-9d3d-45cc-8f3c-567181f59486 for instance c5e3aa48-e46d-4063-bec2-139465c7b571 on hv-cinder-85427 Sep 13 10:24:09.104809 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-3add8754-f37e-4cbc-832b-a8727e150bc5 req-90fd43c8-c000-4171-908e-45fff1680a29 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 Sep 13 10:24:09.105423 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 512/1025] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:09.149656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:09.158009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fa040f84-821f-4604-a3c2-fe482f4e0391 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1274 microversion: 2.1 time: 0.130135 Sep 13 10:24:09.158690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 514/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:09 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:09.167588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:09.168310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:09.175408 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:09.175908 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:09.176361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:09.177064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:09.177529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:09.177965 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:09.250160 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:09.258289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e75372e5-91d5-4820-b1ae-2001abf6bac3 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1383 microversion: 2.1 time: 0.096121 Sep 13 10:24:09.258861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 513/1027] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:09 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1383 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:10.183686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:10.184623 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:10.191544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:10.192492 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:10.194058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:10.194529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:10.195196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:10.195931 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:10.196381 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:10.196800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:10.282585 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:10.283338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:10.291294 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:10.292056 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:10.292488 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:10.293187 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:10.293836 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:10.294421 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:10.333365 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:10.333852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:10.334449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:10.335289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lazy-loading 'fault' on Instance uuid c5e3aa48-e46d-4063-bec2-139465c7b571 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:24:10.415752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969b244842434bb09642122db0d159c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef16a5156d9421e85b4106cce719b4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:10.423905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-16e980d8-097f-4808-9bd8-59ac50d789eb tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 200 len: 1224 microversion: 2.1 time: 0.145869 Sep 13 10:24:10.429074 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 514/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:10 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:10.438194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:10.446617 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6ef95202-f158-49e2-a185-3c275e735fed tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.266730 Sep 13 10:24:10.447404 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 515/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:10 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:11.140450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96121874-0b42-44f2-9128-cdfb26ca6fc6", "tag": "ffa69d98-9299-4f8e-9a4f-26e72cddf68d"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:11.150224 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:11.150518 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:11.150953 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:11.165605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] Creating event network-changed:ffa69d98-9299-4f8e-9a4f-26e72cddf68d for instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 on hv-cinder-85427 Sep 13 10:24:11.170223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-a58d8e8b-fde3-4e24-899d-94a01aaa8328 req-a7ff9552-729d-4e51-96f4-626460b49399 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033489 Sep 13 10:24:11.171685 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 515/1030] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:11.448910 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:11.449534 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] [instance: c5e3aa48-e46d-4063-bec2-139465c7b571] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:11.456817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:11.457307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:11.458009 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:11.458717 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:11.459195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:11.459625 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:11.470410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:11.471110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:11.473161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:11.478970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:11.479675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:11.480228 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:11.480995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:11.481529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:11.482026 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:11.482128 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] HTTP exception thrown: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Request method failure captured: Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 HTTP/1.1 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFj4UPcArKFSlXN1klZYgiOXc9zU5BX_WVye_hTzKUvUR4_fVKtR3pBexq-T4mSsn2YNh-J6Tdm-N7J0k9OFmtsl9UxOJOBxjZrIPs4E_L13HCAt6q1tFOXKu_Kty_f2QpEVoXYkT1MbCw2hJ24P5pxXGb427LMyxL9psgqbNKUyDh8 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 9ef16a5156d9421e85b4106cce719b4f Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-TestShelveInstance-981353084 Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:24:11.484287 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9ef16a5156d9421e85b4106cce719b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9ef16a5156d9421e85b4106cce719b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9ef16a5156d9421e85b4106cce719b4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9ef16a5156d9421e85b4106cce719b4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-TestShelveInstance-981353084 Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 9ef16a5156d9421e85b4106cce719b4f Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-TestShelveInstance-981353084 Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-TestShelveInstance-981353084-project Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 969b244842434bb09642122db0d159c0 Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-TestShelveInstance-981353084-project Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. Sep 13 10:24:11.491122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'c5e3aa48-e46d-4063-bec2-139465c7b571'} Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:24:11.492344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. Sep 13 10:24:11.494135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:24:11.495842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Returning 404 to user: Instance c5e3aa48-e46d-4063-bec2-139465c7b571 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:24:11.495842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-26163f0f-788b-4c0e-80f4-a00068a33597 tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571" status: 404 len: 111 microversion: 2.1 time: 0.041428 Sep 13 10:24:11.495842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 516/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:11 2022] GET /compute/v2.1/servers/c5e3aa48-e46d-4063-bec2-139465c7b571 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:24:11.627480 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:11.635775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0c69329d-97c2-4b02-925b-14bc9c83f46c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.169406 Sep 13 10:24:11.639338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 516/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:11 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:11.726839 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-8bb0a73c-e99c-418d-b2fc-e10e673e457e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] Calling method '.version_select at 0x7f46c4841670>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:11.821410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-8bb0a73c-e99c-418d-b2fc-e10e673e457e tempest-TestShelveInstance-981353084 tempest-TestShelveInstance-981353084-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-336711284" status: 202 len: 0 microversion: 2.1 time: 0.098987 Sep 13 10:24:11.822021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 517/1033] 10.222.0.62 () {58 vars in 1251 bytes} [Tue Sep 13 10:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-336711284 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:24:12.659335 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:12.659954 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:12.667110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:12.667578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:12.668087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:12.669015 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:12.669475 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:12.669896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:13.172961 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:13.183622 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1a801c65-5b2a-45c4-a52d-01a4ab1cb240 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.528136 Sep 13 10:24:13.187425 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 517/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:12 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:14.212635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:14.213933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:14.241530 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:14.243594 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:14.245466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:14.253783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:14.253783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:14.253783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:14.510757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:14.520168 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-fa75ca1b-245d-4574-937e-9cfa92137e1e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.314351 Sep 13 10:24:14.521161 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 518/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:14 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:15.544524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:15.545243 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:15.552067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:15.552650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:15.553162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:15.553934 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:15.554466 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:15.554981 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:15.793539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:15.801926 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-677e1c2a-e87f-41e8-8495-f614b2b1d9bb tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.261220 Sep 13 10:24:15.802669 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 518/1036] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:15 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:16.603312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96121874-0b42-44f2-9128-cdfb26ca6fc6", "name": "network-vif-plugged", "status": "completed", "tag": "ffa69d98-9299-4f8e-9a4f-26e72cddf68d"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:16.614377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:16.614377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:16.614544 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:16.627019 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] Creating event network-vif-plugged:ffa69d98-9299-4f8e-9a4f-26e72cddf68d for instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 on hv-cinder-85427 Sep 13 10:24:16.632041 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-83b576c5-ac45-4022-896d-5e18ec611114 req-83fc7c40-6562-4bbd-b760-f52b50c15d4c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Sep 13 10:24:16.632620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 519/1037] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:16.825418 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:16.826853 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:16.836720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:16.837209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:16.837650 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:16.838352 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:16.838806 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:16.839257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:17.035586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:17.075962 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-18e6ea4f-aae7-4d1b-b499-8997c2acb1d5 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.227756 Sep 13 10:24:17.076637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 519/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:16 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:18.100385 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:18.101089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:18.107460 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:18.107891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:18.108884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:18.109580 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:18.110033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:18.110592 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:18.255652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:18.266844 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4b0f67f1-3f5e-4711-9eac-8509be93366c tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1316 microversion: 2.1 time: 0.171189 Sep 13 10:24:18.271223 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 520/1039] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:18 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:19.293851 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:19.294647 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:19.302080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:19.302683 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:19.303115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:19.303883 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:19.304407 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:19.304719 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:19.459954 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:19.472260 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-08aed359-813b-4ffd-87de-eafc385c6ded tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1505 microversion: 2.1 time: 0.182238 Sep 13 10:24:19.474591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 520/1040] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:19 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:36.571080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-268222651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-869991838", "security_groups": [{"name": "tempest-secgroup-smoke-1867770006"}], "block_device_mapping_v2": [{"uuid": "11939b4a-9cc3-4bf1-ae62-52560505f0b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "efbc911f-ad2a-4c68-952b-f6a00ba8476f"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:36.581671 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:36.582351 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:36.686642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] validate_networks() for [('efbc911f-ad2a-4c68-952b-f6a00ba8476f', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:24:37.073386 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:24:37.073837 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:24:37.074332 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:24:37.074766 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:24:37.075195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:24:37.084096 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:37.084576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:37.085011 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:37.085778 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:37.086228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:37.086649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:37.103672 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:24:37.107474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Getting quotas for user 7ddb2572cac446aa92a0bcf170d9e8d6 and project 7cc199dd87e24511a8d267603b571456. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:24:37.167324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:24:37.169591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11939b4a-9cc3-4bf1-ae62-52560505f0b5',volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:24:37.591143 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ced1a2c6-1899-4315-babc-b52d3b47e93c tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.024528 Sep 13 10:24:37.592069 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 521/1041] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:24:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:24:37.604279 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-33afe071-041f-4650-96fc-933087e12ad1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:37.604894 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-33afe071-041f-4650-96fc-933087e12ad1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:37.607388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=36 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:37.608108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=80 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:37.669941 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-33afe071-041f-4650-96fc-933087e12ad1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:37.677509 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-33afe071-041f-4650-96fc-933087e12ad1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1093 microversion: 2.1 time: 0.077323 Sep 13 10:24:37.681021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 521/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:37 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:38.703668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:38.704282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:38.710408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:38.710927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:38.711383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:38.712055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:38.712512 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:38.712938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:38.776330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:38.784164 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3a55c625-ecc8-4f9e-9663-6447eeb0c2b3 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1143 microversion: 2.1 time: 0.084792 Sep 13 10:24:38.784723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 522/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:38 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:39.808271 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:39.808882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:39.820503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:39.820503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:39.820503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:39.820503 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:39.820869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:39.820869 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:40.200871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:40.208855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-3f68ec35-ab0c-4b2e-b4e8-6bb63c07a43a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1191 microversion: 2.1 time: 0.404708 Sep 13 10:24:40.209710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 522/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:39 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1191 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:40.946555 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9355f528-fc43-46d1-b8bf-300fb7940454", "device": "/dev/sdb"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:40.950881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:40.960139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:40.962198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:40.962198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:40.962198 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:40.962569 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:40.963022 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:41.234192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:41.234942 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:41.252727 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:41.253757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:41.255571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:41.256656 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:41.260591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:41.261283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:41.531583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:41.539775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c326298a-57c7-43ee-b46a-626fd837b015 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1277 microversion: 2.1 time: 0.309607 Sep 13 10:24:41.540595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 523/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:41 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:42.085281 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29b9f57-00c0-4847-9bdb-c5f65fb7059a", "tag": "bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:24:42.096049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:42.098162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:42.098162 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:42.109633 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] Creating event network-changed:bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2 for instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a on hv-cinder-85427 Sep 13 10:24:42.114773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-3b346585-effe-4714-8ce2-1f3b8153681a req-200b90f6-5d8d-4743-b3d1-c9b05ce83cbc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Sep 13 10:24:42.115405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 524/1046] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:42.201051 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-6d966425-1c39-4a97-82f7-6d50b0806c1f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "POST /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.260550 Sep 13 10:24:42.201830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 523/1047] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:24:40 2022] POST /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6/os-volume_attachments => generated 194 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:24:42.565641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:42.566337 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:42.573158 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:42.573641 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:42.574075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:42.574763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:42.575244 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:42.575668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:42.707043 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:42.715440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-434b1e4d-dd71-4540-ac04-32c04e4da1d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.154444 Sep 13 10:24:42.716005 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 525/1048] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:42 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:43.739001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:43.739735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:43.745835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:43.746322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:43.746759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:43.747508 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:43.747969 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:43.748396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:43.883139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:43.890783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-06135baa-629e-4bd2-9f5d-23dab2334944 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.156528 Sep 13 10:24:43.891384 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 524/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:43 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:44.917870 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:44.918481 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:44.924933 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:44.925417 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:44.925855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:44.927192 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:44.927649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:44.928075 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:45.060440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:45.068191 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a93518dd-b35c-47ad-be8f-6b9fc035f7f4 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.154160 Sep 13 10:24:45.068849 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 526/1050] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:44 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:46.091792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:46.092485 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:46.099640 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:46.100129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:46.100570 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:46.101268 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:46.101723 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:46.102158 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:46.233912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:46.244046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b9b8fc55-8fe5-4dde-8ace-58d7459050f1 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.156199 Sep 13 10:24:46.244690 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 525/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:46 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:47.267220 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:47.267838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:47.274575 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:47.275067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:47.275532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:47.276500 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:47.276958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:47.277389 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:47.420325 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:47.428354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-fc4dbb7b-5c1e-4c72-b2fb-53a2c9d2269d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.165201 Sep 13 10:24:47.428920 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 527/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:47 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:24:48.451995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:48.452620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:48.454580 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:48.455743 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:48.461874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:48.461874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:48.462188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:48.462888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:48.463380 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:48.463810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:48.665648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:48.674228 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-677e308b-cf5b-4be4-ace0-2f41732c45a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.226086 Sep 13 10:24:48.675412 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 526/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:48 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:49.698274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:49.701572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:49.705864 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=2 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:24:49.708663 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:49.709695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:49.710461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:49.711363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:49.711977 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:49.712559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:49.856929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:49.864644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0c31c9e0-65d8-4ab6-a640-05593c4ba4a7 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.170946 Sep 13 10:24:49.865211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 528/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:49 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:50.887621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:50.888227 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:50.895786 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:50.896271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:50.896702 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:50.897398 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:50.897841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:50.898462 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:51.055922 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:51.059587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7e3eeb8a-cc16-4984-b4ee-a31e70d94b9e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.175655 Sep 13 10:24:51.060160 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 527/1055] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:50 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:52.081991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:52.083282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:52.090473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:52.091181 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:52.091621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:52.092439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:52.092784 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:52.093197 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:52.233972 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:52.240865 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-5221f251-7da7-4ab7-a6eb-9ae17a233725 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.162728 Sep 13 10:24:52.241508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 529/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:52 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:53.264403 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:53.265103 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:53.274940 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:53.275588 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:53.276468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:53.277185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:53.277651 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:53.278085 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:53.430819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:53.438591 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-def57338-07c9-4684-8bf4-ec148c6f3bd8 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.178110 Sep 13 10:24:53.439156 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 528/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:53 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:54.463613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:54.464302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:54.473899 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:54.474332 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:54.474655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:54.475378 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:54.475830 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:54.476248 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:54.614524 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:54.622693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-1fdf161c-c368-4820-9490-0fa1e542e4cf tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.163273 Sep 13 10:24:54.638672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 530/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:54 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:55.646528 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:55.647150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:55.654079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:55.658440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:55.658440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:55.658440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:55.658440 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:55.659212 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:55.795642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:55.803826 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7a9fd018-7ea3-47df-85b7-5b5f24dc179a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.161536 Sep 13 10:24:55.804473 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 529/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:55 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:56.827963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:56.829143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:56.836296 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:56.836688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:56.837128 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:56.838458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:56.838929 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:56.839400 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:57.070063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:57.081708 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-180e577a-2f8a-4d32-bf04-b85776dbc03e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.257955 Sep 13 10:24:57.084516 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 531/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:56 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:58.107905 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:58.108514 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:58.115687 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:58.116305 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:58.116734 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:58.117498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:58.117946 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:58.118677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:58.256105 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:58.263876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-76cbdebf-14ae-4242-b566-591bd3721c3e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.160023 Sep 13 10:24:58.264441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 530/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:58 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:24:59.288233 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:24:59.288842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:24:59.295854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:59.296377 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:59.296994 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:59.297756 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:24:59.298216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:24:59.298649 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:24:59.532131 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:24:59.544385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-72c46904-b65b-45e4-914e-8b2ba059244a tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.260066 Sep 13 10:24:59.545313 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 532/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:24:59 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:00.323139 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29b9f57-00c0-4847-9bdb-c5f65fb7059a", "name": "network-vif-plugged", "status": "completed", "tag": "bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:00.337054 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:00.337652 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:00.338080 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:00.355107 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] Creating event network-vif-plugged:bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2 for instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a on hv-cinder-85427 Sep 13 10:25:00.356207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-d8ec243b-4bf2-46e4-b828-0464087ed5ca req-18bc4db7-6782-4cac-b250-19892d898d36 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Sep 13 10:25:00.357337 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 531/1063] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:00.568705 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:00.569569 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:00.577019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:00.577829 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:00.578777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:00.579760 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:00.580440 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:00.581924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:00.826050 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:00.837334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-2147413b-3f67-4580-93dc-dbfca9238f55 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.272163 Sep 13 10:25:00.839366 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 533/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:00 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:01.862433 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:01.863257 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:01.870194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:01.870767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:01.871316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:01.872098 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:01.872627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:01.873180 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:02.031124 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:02.040004 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f61e76a5-e083-42b9-b9f7-7ad655ec5819 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.181781 Sep 13 10:25:02.040704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 532/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:01 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:03.067960 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:03.067960 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:03.074920 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:03.075461 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:03.075904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:03.076620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:03.077082 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:03.077512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:03.300749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:03.317898 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c4041276-6071-4907-8520-ba9bb8ea807d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1265 microversion: 2.1 time: 0.254884 Sep 13 10:25:03.319788 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 534/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:03 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:04.346300 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:04.346300 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:04.353343 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:04.353842 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:04.354280 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:04.354989 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:04.355476 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:04.355899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:04.540951 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:04.549648 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e3e61829-5504-4641-9db4-ee52cf807b35 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1452 microversion: 2.1 time: 0.209049 Sep 13 10:25:04.550221 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 533/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:04 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:04.575078 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:04.576247 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:04.583011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:04.583783 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:04.584211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:04.585088 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:04.585801 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:04.586619 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:04.825630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:04.834586 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e45a3298-82be-4958-9616-675c8f70bdcd tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1452 microversion: 2.1 time: 0.263329 Sep 13 10:25:04.835284 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 535/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:04 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1452 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:08.004749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29b9f57-00c0-4847-9bdb-c5f65fb7059a", "tag": "bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:08.012957 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:08.017612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:08.018188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:08.018681 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:08.031822 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:08.041246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] Creating event network-changed:bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2 for instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a on hv-cinder-85427 Sep 13 10:25:08.046701 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-bb66bb86-1499-434d-b757-1f2f5192b521 req-808eb436-67a6-4286-ad8c-a65f0db7ad52 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051442 Sep 13 10:25:08.047475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 534/1069] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:10.571858 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:10.572457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:10.575361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=33 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:10.580151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:10.580688 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:10.581482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:10.582173 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:10.583206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:10.583777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:10.586593 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=81 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:10.675600 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lazy-loading 'services' on Instance uuid 96121874-0b42-44f2-9128-cdfb26ca6fc6 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:25:10.916604 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-87d93153-1f7a-40ea-8f46-13f0d7b8ce3d tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "DELETE /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6/os-volume_attachments/9355f528-fc43-46d1-b8bf-300fb7940454" status: 202 len: 0 microversion: 2.1 time: 0.348741 Sep 13 10:25:10.917952 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 536/1070] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:25:10 2022] DELETE /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6/os-volume_attachments/9355f528-fc43-46d1-b8bf-300fb7940454 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:25:12.114597 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:12.119063 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:12.123926 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:12.124599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:12.125207 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:12.126108 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:12.126726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:12.127345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:12.172377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:25:12.550401 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7ca6267b-11df-4c36-83ea-6af26a21ddb6 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "DELETE /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 204 len: 0 microversion: 2.1 time: 0.441226 Sep 13 10:25:12.554855 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 535/1071] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:25:12 2022] DELETE /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:25:12.560767 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:12.561471 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:12.569473 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:12.570061 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:12.570613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:12.571426 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:12.571974 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:12.572484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:12.727572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:12.736386 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-45f85775-d6d7-4867-9474-52227d1c48cf tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1511 microversion: 2.1 time: 0.179986 Sep 13 10:25:12.737262 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 537/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:12 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:13.766835 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:13.767616 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:13.779923 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:13.780819 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:13.781496 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:13.782285 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:13.782861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:13.783378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:13.944190 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:13.952767 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b16aa5ef-7442-498f-b92b-533cbfe20a0f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1511 microversion: 2.1 time: 0.190428 Sep 13 10:25:13.953642 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 536/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:13 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:14.976757 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:14.977431 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:14.984397 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:14.984882 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:14.985317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:14.986042 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:14.986494 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:14.986916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:15.550638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96121874-0b42-44f2-9128-cdfb26ca6fc6", "name": "network-vif-deleted", "tag": "ffa69d98-9299-4f8e-9a4f-26e72cddf68d"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:15.559571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:15.568668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e830a6d2-5977-42c6-9eb2-bca8c447d0f1 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1511 microversion: 2.1 time: 0.596565 Sep 13 10:25:15.569326 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 538/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:14 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:15.575312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:15.575792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:15.579918 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:15.595046 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] Creating event network-vif-deleted:ffa69d98-9299-4f8e-9a4f-26e72cddf68d for instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 on hv-cinder-85427 Sep 13 10:25:15.605396 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-d6e4e211-0973-4174-84b7-25555528f9d1 req-7b3948f5-936d-47e5-9cd9-2526663a5ca5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057554 Sep 13 10:25:15.618017 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 537/1075] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:25:16.604001 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:16.606327 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:16.618872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:16.619651 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:16.620274 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:16.621144 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:16.621775 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:16.622363 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:16.668282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:16.672725 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:16.673511 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:16.674186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lazy-loading 'fault' on Instance uuid 96121874-0b42-44f2-9128-cdfb26ca6fc6 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:25:16.732521 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:16.750116 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a2a4d121-66c5-4390-8d6a-af418d1308be tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 200 len: 1306 microversion: 2.1 time: 0.161275 Sep 13 10:25:16.752375 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 539/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:16 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:17.777323 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:17.778055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 96121874-0b42-44f2-9128-cdfb26ca6fc6] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:17.786892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:17.787817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:17.788491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:17.789414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:17.789959 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:17.790484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:17.805316 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] HTTP exception thrown: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Request method failure captured: Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 HTTP/1.1 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFo9Gud1e_e_F4DkMaRiwaDK2audvNvF-lH_WMnf5r6J8e6ug-3jqfVWjEKp0zDHmRUPVNzkJXCbUPJ65VAHYjjiZ0jtgj3GHkf3WFsVrvOeZmhJqYGzwmdMGWv3yoh2q0coLTaxllSMMnYDyDlfN_zoxPTT_McHkg1BeMC8bh9eqy4 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 8879b3720c0d482d8118a0d2e5590b54 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:25:17.807360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 8879b3720c0d482d8118a0d2e5590b54 Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-VolumesSnapshotTestJSON-1157562262-project Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 9a6e7e1e625247a3963aa8a0a29eb478 Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-VolumesSnapshotTestJSON-1157562262-project Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. Sep 13 10:25:17.809039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '96121874-0b42-44f2-9128-cdfb26ca6fc6'} Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:25:17.809824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. Sep 13 10:25:17.811135 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:25:17.812342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Returning 404 to user: Instance 96121874-0b42-44f2-9128-cdfb26ca6fc6 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:25:17.812342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f45e8fe8-7cb3-4ff4-af3a-ccb0a5905917 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6" status: 404 len: 111 microversion: 2.1 time: 0.037780 Sep 13 10:25:17.812342 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 538/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:17 2022] GET /compute/v2.1/servers/96121874-0b42-44f2-9128-cdfb26ca6fc6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:25:22.732022 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-51b3a988-a066-4ccf-a288-975090755c52 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'create', calling method: .version_select at 0x7f46c10da940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-782283516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBX9kw/kHxttiMJFKlGLlOSFhGiKHN7ysx+pAvioYYYG+22SVYNlb5Yzq3ntVg6xZSyiOTiaJc+vrI8c4WRwN/PFqdiMhTPFbKx8URvoYn5wbXY6cj+ZrDYhIhniGatvA=="}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:22.748305 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-51b3a988-a066-4ccf-a288-975090755c52 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Getting quotas for project d3610ef4e07548e1a88d76356d8170a6. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:25:22.752651 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.quota [None req-51b3a988-a066-4ccf-a288-975090755c52 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Getting quotas for user 31a26b7651fd463393526fab64ccf1c7 and project d3610ef4e07548e1a88d76356d8170a6. Resources: {'key_pairs'} {{(pid=121003) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:25:22.828794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-51b3a988-a066-4ccf-a288-975090755c52 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.100645 Sep 13 10:25:22.831450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 540/1078] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Sep 13 10:25:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:22.883650 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1771975464", "imageRef": "c4af08cd-013f-41b8-805d-a26f2ddaf410", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-782283516", "networks": [{"uuid": "8e9198e1-8b95-45e8-9784-8a7e46e77b67"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:22.935112 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] validate_networks() for [('8e9198e1-8b95-45e8-9784-8a7e46e77b67', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:25:23.303848 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:25:23.304277 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:25:23.304755 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:25:23.305165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:25:23.305605 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:25:23.314426 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:23.314910 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:23.315385 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:23.319283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:23.319283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:23.319283 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:23.333958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Getting quotas for project d3610ef4e07548e1a88d76356d8170a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:25:23.337899 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Getting quotas for user 31a26b7651fd463393526fab64ccf1c7 and project d3610ef4e07548e1a88d76356d8170a6. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:25:23.348805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:25:23.351014 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c4af08cd-013f-41b8-805d-a26f2ddaf410',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:25:23.470810 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f05f3e43-620a-4478-8c13-98e6f93159f0 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590907 Sep 13 10:25:23.471486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 539/1079] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:25:23.482548 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-be94e7a4-f326-4714-9423-d24205b10044 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:23.483177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-be94e7a4-f326-4714-9423-d24205b10044 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:23.542070 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-be94e7a4-f326-4714-9423-d24205b10044 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:23.549729 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-be94e7a4-f326-4714-9423-d24205b10044 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1258 microversion: 2.1 time: 0.071030 Sep 13 10:25:23.550288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 541/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:23 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:24.573632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:24.574246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:24.580945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:24.581424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:24.581867 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:24.583131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:24.583620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:24.584049 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:24.644945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:24.653427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4f534d45-c07b-410d-a6e8-4dd68ab1cb97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1262 microversion: 2.1 time: 0.084229 Sep 13 10:25:24.654033 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 540/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:24 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:25.676608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:25.677229 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:25.683763 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:25.684487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:25.684938 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:25.689207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:25.689207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:25.689207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:25.755530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:25.763690 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c02eda07-3825-4da4-87ba-ec8d1d84774b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1310 microversion: 2.1 time: 0.091295 Sep 13 10:25:25.764278 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 542/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:25 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:26.787632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:26.790249 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:26.795038 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:26.795562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:26.796003 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:26.796788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:26.797248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:26.797679 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:26.930765 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:26.938645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-b4758e33-cea5-4495-ba3b-ba3a1923d737 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.155024 Sep 13 10:25:26.939293 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 541/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:26 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:27.962528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:27.963141 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:27.969841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:27.970334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:27.970769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:27.971498 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:27.971948 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:27.972385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:28.108238 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:28.115603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-38a65284-f5f9-49fc-bfec-91b6aeaf48de tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.157533 Sep 13 10:25:28.116177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 543/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:27 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:29.138813 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:29.139474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:29.146170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:29.146794 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:29.147349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:29.148127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:29.148665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:29.149184 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:29.308418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:29.316185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-bc51b734-84c6-46e5-ae8b-a06056691916 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.181072 Sep 13 10:25:29.317125 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 542/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:29 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:29.881954 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:29.893063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:29.894080 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:29.894550 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:29.932354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] Creating event network-changed:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:25:29.932354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-f4a8a8ae-e348-4356-9005-503cfe1dd5ce req-ef5a73d6-1295-4c6b-b561-d81d7927d039 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 Sep 13 10:25:29.932354 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 544/1086] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:30.042992 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1145303961", "imageRef": "a39ba3ae-d061-4ab9-be37-29486f4b150c", "flavorRef": "452", "networks": [{"uuid": "8d49a057-6bd8-4080-b93e-159c540d819c"}]}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:30.107466 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.network.neutron [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] validate_networks() for [('8d49a057-6bd8-4080-b93e-159c540d819c', None, None, None, None, None)] {{(pid=121002) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 10:25:30.341348 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:30.342115 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:30.348734 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:30.349231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:30.349675 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:30.350390 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:30.351084 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:30.351543 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:30.563193 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Flavor limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 10:25:30.563808 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Image limits 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 10:25:30.564410 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Flavor pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 10:25:30.565912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Image pref 0:0:0 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 10:25:30.566575 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.virt.hardware [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121002) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 10:25:30.578504 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:30.579776 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:30.580486 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:30.581515 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:30.582039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:30.582860 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:30.586311 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:30.598169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-650ee592-eae6-4405-ba56-f3ee7a3de9a4 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.261494 Sep 13 10:25:30.598790 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 545/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:30 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:30.611377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Getting quotas for project 8879b3720c0d482d8118a0d2e5590b54. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 10:25:30.611377 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.quota [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Getting quotas for user 9a6e7e1e625247a3963aa8a0a29eb478 and project 8879b3720c0d482d8118a0d2e5590b54. Resources: {'ram', 'instances', 'cores'} {{(pid=121002) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 10:25:30.622491 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Going to run 1 instances... {{(pid=121002) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 10:25:30.625307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a39ba3ae-d061-4ab9-be37-29486f4b150c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121002) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 10:25:30.760089 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f276345a-835c-4871-b58d-9e18168d7c07 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721099 Sep 13 10:25:30.767565 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 543/1088] 10.222.0.62 () {60 vars in 1147 bytes} [Tue Sep 13 10:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 10:25:30.777077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-18b14d77-30db-46f9-93ab-e274d42a3fea tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:30.777913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-18b14d77-30db-46f9-93ab-e274d42a3fea tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:30.867968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-18b14d77-30db-46f9-93ab-e274d42a3fea tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:30.878912 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-18b14d77-30db-46f9-93ab-e274d42a3fea tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1219 microversion: 2.1 time: 0.106099 Sep 13 10:25:30.879523 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 546/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:30 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:31.623151 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:31.623795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:31.630832 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:31.631586 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:31.632194 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:31.633191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:31.633885 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:31.634487 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:31.778340 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:31.786706 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c8f13eb5-19a9-4932-8933-828835ea14ed tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.168407 Sep 13 10:25:31.787302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 544/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:31 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:31.914958 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:31.915621 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:31.931605 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:31.932339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:31.932811 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:31.934097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:31.934097 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:31.935147 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:32.009077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:32.017612 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c034de90-b0e7-4613-97ea-5f5c44a31c05 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.113395 Sep 13 10:25:32.026592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 547/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:31 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:32.809903 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:32.810622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:32.818612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:32.819281 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:32.819834 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:32.820533 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:32.820981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:32.821402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:32.956195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:32.964506 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2993a9c6-0a19-4c4c-9f1f-35b516f4124a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.158366 Sep 13 10:25:32.965429 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 545/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:32 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:33.046439 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:33.047608 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:33.054787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:33.055525 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:33.056156 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:33.056878 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:33.057346 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:33.057777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:33.130195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:33.138053 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4733664d-4c35-4fa1-a9f5-68519dd8da1a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.096480 Sep 13 10:25:33.138630 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 548/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:33 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:33.988724 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:33.990025 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:33.997082 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:33.997576 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:33.998013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:33.998720 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:33.999196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:33.999627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:34.143481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:34.152414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-1b7cf1aa-573a-4035-a96f-215c10e16e3e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.167512 Sep 13 10:25:34.156106 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 546/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:33 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:34.161730 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:34.162413 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:34.169161 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:34.169644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:34.170276 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:34.170987 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:34.171456 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:34.171881 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:34.249490 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:34.258099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-01358426-5c45-43f9-9d06-2300f36de9c8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.100179 Sep 13 10:25:34.258668 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 549/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:34 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:35.176975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:35.177660 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:35.184134 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:35.184620 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:35.185059 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:35.185759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:35.186215 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:35.186645 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:35.281422 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:35.282034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:35.289310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:35.290093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:35.290752 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:35.291701 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:35.292367 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:35.292877 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:35.325846 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:35.337694 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-14efec22-c716-4a88-bf29-0c2d40a51eb9 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.164988 Sep 13 10:25:35.338649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 547/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:35 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:35.378750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:35.388289 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bc398f02-2158-4678-9a12-cfaa4727e1e2 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.110812 Sep 13 10:25:35.389013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 550/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:35 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:36.364306 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:36.365021 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:36.371798 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:36.372297 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:36.372726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:36.373665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:36.374191 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:36.374738 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:36.412245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:36.413751 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:36.421741 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:36.428510 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:36.428963 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:36.429714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:36.431189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:36.431655 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:36.517046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:36.526530 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a66d1f20-1841-4eef-b124-2e7571e85035 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.118173 Sep 13 10:25:36.527092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 551/1098] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:36 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:36.569824 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:36.577913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d876ad3d-9dd4-4dd2-908f-bb2beb00f88d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.218743 Sep 13 10:25:36.578481 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 548/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:36 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:37.550072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:37.550711 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:37.557940 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:37.558419 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:37.558855 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:37.559566 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:37.560024 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:37.560451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:37.602609 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:37.603264 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:37.609814 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:37.610302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:37.610740 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:37.611472 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:37.611934 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:37.612457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:37.623251 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:37.631532 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-d8f1ff99-a8a3-4dfc-b443-8427374db188 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1223 microversion: 2.1 time: 0.085223 Sep 13 10:25:37.632111 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 552/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:37 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:37.746701 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:37.763408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-623ea968-e964-43b2-84a4-05788a3ee331 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.157100 Sep 13 10:25:37.763408 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 549/1101] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:37 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:38.653995 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:38.655367 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:38.662195 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:38.662682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:38.663119 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:38.663854 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:38.664307 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:38.664733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:38.772468 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:38.779331 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:38.779945 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:38.780645 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-364ddbd9-82c7-41c6-a1f0-d581763a7552 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1215 microversion: 2.1 time: 0.130739 Sep 13 10:25:38.781531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 553/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:38 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:38.787788 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:38.788294 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:38.788759 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:38.789656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:38.790109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:38.790711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:39.023424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:39.031414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f2dd4b9f-296d-47f7-8691-cde0dd4a0760 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.256308 Sep 13 10:25:39.031993 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 550/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:38 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:39.804269 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:39.804939 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:39.811310 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:39.811800 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:39.812245 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:39.812957 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:39.813508 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:39.813937 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:39.875998 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:39.884239 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7dfd3194-ef5e-4b36-8a92-1c8ceb8a8d9e tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1271 microversion: 2.1 time: 0.083966 Sep 13 10:25:39.884838 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 554/1104] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:39 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:40.054475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:40.055067 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:40.061457 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:40.061936 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:40.062370 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:40.063065 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:40.063547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:40.063975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:40.349147 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:40.357362 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-7b2805d0-e432-4a89-808e-8b30121edf6f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.307414 Sep 13 10:25:40.357933 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 551/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:40 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:40.907458 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:40.908079 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:40.910489 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell0:SELECT=8 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:40.911190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:40.915916 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:40.923773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:40.923773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:40.923773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:40.923773 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:40.924159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:40.924159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:40.979231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:40.986993 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-37f92b61-0c9b-47ba-a17a-31392febcfb3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1271 microversion: 2.1 time: 0.083431 Sep 13 10:25:40.987603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 555/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:40 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:41.381165 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:41.382796 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:41.385020 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=4 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:41.385711 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=12 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:41.395548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:41.395548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:41.395548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:41.395548 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:41.395970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:41.395970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:41.408970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:41.526090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:41.533599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-696fb889-5391-4680-9cb6-7bd6129b3bf8 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.156379 Sep 13 10:25:41.534163 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 552/1107] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:41 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:42.010257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:42.010871 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:42.018682 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:42.019186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:42.019640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:42.020385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:42.020841 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:42.021277 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:42.083372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:42.091315 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-435fd36b-4346-48f0-a333-3a0f83c3d7ab tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1271 microversion: 2.1 time: 0.085674 Sep 13 10:25:42.091879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 556/1108] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:42 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:42.557913 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:42.558531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:42.560928 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:42.566244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:42.566726 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:42.567185 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:42.567881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:42.568330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:42.569251 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:42.700587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:42.708172 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-cdb5a08f-c6ab-42b1-ab80-907d62bf0e60 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.154831 Sep 13 10:25:42.708735 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 553/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:42 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:43.114983 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:43.116349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:43.124665 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:43.125157 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:43.125592 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:43.126666 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:43.127143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:43.127821 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:43.206411 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:43.219334 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ec903435-5e6d-49ef-b5bd-2496d63c1988 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1279 microversion: 2.1 time: 0.108564 Sep 13 10:25:43.220559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 557/1110] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:43 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:43.732058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:43.732774 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:43.739676 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:43.740195 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:43.741130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:43.741861 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:43.742450 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:43.742875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:43.955282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:43.963601 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-a5438117-937a-44d4-a5fe-b3b6039d5bf1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.236278 Sep 13 10:25:43.975748 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 554/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:43 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:44.168488 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "name": "network-vif-plugged", "status": "completed", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:44.178876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:44.179385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:44.179812 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:44.190331 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] Creating event network-vif-plugged:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:25:44.196201 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-a0996e76-a3d8-41c1-857d-93f48f31262a req-bd540def-6197-4d72-bbbb-5e75e277a5c4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Sep 13 10:25:44.196796 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 558/1112] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:44.243231 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:44.243750 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:44.249999 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:44.253253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:44.253253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:44.253253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:44.253253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:44.253632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:44.777596 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:44.785252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-eb3bc064-6e15-4105-9684-952ac42e5d04 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.546761 Sep 13 10:25:44.785968 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 555/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:44 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:44.988528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:44.989223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:44.995733 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:44.996212 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:44.996644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:44.997322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:44.997769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:44.998189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:45.208169 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:45.215985 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f1f5adee-6727-418a-b5b2-3e33f2ac96bc tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.231733 Sep 13 10:25:45.220493 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 559/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:44 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:45.541130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b41dbc-aaf8-40d3-bc50-3181da5d9be1", "tag": "4ea80b05-ea23-47ba-9009-b42713d74310"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:45.550595 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:45.554841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:45.554841 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:45.563376 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] Creating event network-changed:4ea80b05-ea23-47ba-9009-b42713d74310 for instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 on hv-cinder-85427 Sep 13 10:25:45.568654 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-f392aca2-f7b1-4508-ba8f-bef4f319b203 req-c10665eb-5417-4641-951c-6a7ab509e92e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031649 Sep 13 10:25:45.569282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 556/1115] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:45.808627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:45.809237 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:45.815223 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:45.815711 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:45.816146 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:45.816839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:45.817291 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:45.817720 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:46.060179 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:46.068589 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-494540b5-c79b-4b12-98cd-6d00867d9a31 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.263755 Sep 13 10:25:46.069438 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 560/1116] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:45 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:46.240091 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:46.241372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:46.247498 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:46.247977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:46.248418 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:46.249095 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:46.249564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:46.249965 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:46.378272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:46.386123 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-f7657339-b55d-452f-a876-ef25b9538790 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1358 microversion: 2.1 time: 0.150682 Sep 13 10:25:46.386927 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 557/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:46 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:47.091385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:47.092000 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:47.098429 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.098907 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.099378 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.100106 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.100556 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.100980 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.231342 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:47.239091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-db91c19a-cef8-43cc-9b84-737fa8f3a20a tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.151657 Sep 13 10:25:47.239689 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 561/1118] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:47 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:47.409983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:47.416458 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:47.416615 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.417100 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.417538 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.418224 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.418683 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.419109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.551087 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:47.559427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-17e323ef-dce9-412c-96ae-d56ee6463f6a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1548 microversion: 2.1 time: 0.153497 Sep 13 10:25:47.560178 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 558/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:47 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:47.581839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:47.582453 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:47.588262 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.588739 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.589171 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.589857 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.590308 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.590735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.720755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:47.728900 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-c0e82fb9-8940-47d6-bdff-fc0416da24e5 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1548 microversion: 2.1 time: 0.150863 Sep 13 10:25:47.729457 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 562/1120] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:47 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:47.751875 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:47.756444 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:47.757253 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Searching by: {'deleted': False, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6'} {{(pid=121002) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 10:25:47.763884 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.764361 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.764795 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.765518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.765972 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.766402 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.855244 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.multi_cell_list [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121002) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 10:25:47.950136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5f5d3c74-3560-4240-a5a3-ab394c92cf67 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202535 Sep 13 10:25:47.950718 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 559/1121] 10.222.0.62 () {58 vars in 1125 bytes} [Tue Sep 13 10:25:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:47.962735 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:47.963410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:47.969392 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.969875 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.970316 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:47.971013 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:47.971501 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:47.971930 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:48.104636 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:48.112787 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-200e2de4-96c2-4bd8-a6a5-4ee5c6189230 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1548 microversion: 2.1 time: 0.154306 Sep 13 10:25:48.113449 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 563/1122] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:47 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:48.263368 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:48.264292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:48.270801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:48.295043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:48.295043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:48.295043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:48.295043 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:48.295497 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:48.406896 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:48.415536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-753f2f2c-fe98-4dd3-a260-11682e18aad8 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.156851 Sep 13 10:25:48.416167 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 560/1123] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:48 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:49.438645 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:49.439302 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:49.445921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:49.446404 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:49.446839 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:49.447564 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:49.448019 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:49.448450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:49.583216 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:49.591714 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-191ff36b-b8ba-4503-b2b7-9fff07a345f3 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.156938 Sep 13 10:25:49.592283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 564/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:49 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:50.193628 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b82143c-5a61-4afb-85ba-59d8a57ed63e"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:50.197236 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:50.203255 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:50.203806 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:50.204247 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:50.204935 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:50.205382 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:50.205807 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:50.616634 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:50.618288 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:50.627748 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:50.631094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:50.631094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:50.631094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:50.631094 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:50.631534 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:50.767908 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:50.776527 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ac8caec3-fb4f-4ed4-b101-6665015029a7 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.166292 Sep 13 10:25:50.777112 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 565/1125] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:50 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:51.025028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-75e98419-a90d-4ada-8928-16f230021455 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835380 Sep 13 10:25:51.025906 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 561/1126] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:25:50 2022] POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:51.801234 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:51.801846 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:51.808374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:51.808885 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:51.809317 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:51.810108 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:51.810558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:51.811121 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:51.951138 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:51.959077 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8c1cc6fe-a558-447b-8eae-5342df5f1c82 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.163102 Sep 13 10:25:51.959747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 566/1127] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:51 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:52.237476 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b41dbc-aaf8-40d3-bc50-3181da5d9be1", "name": "network-vif-plugged", "status": "completed", "tag": "4ea80b05-ea23-47ba-9009-b42713d74310"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:52.247246 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:52.247719 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:52.248149 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:52.259248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] Creating event network-vif-plugged:4ea80b05-ea23-47ba-9009-b42713d74310 for instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 on hv-cinder-85427 Sep 13 10:25:52.264027 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-be9c89ec-56de-4923-9dba-d9f20f4d0997 req-cca8f8b0-c814-4717-b252-2e830af3052e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Sep 13 10:25:52.269141 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 562/1128] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:25:52.982588 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:52.983219 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:52.989842 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:52.990322 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:52.990749 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:52.991465 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:52.991931 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:52.992952 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:53.125538 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:53.133222 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-89367411-dd5e-442d-a462-ae5eb89f5e10 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1319 microversion: 2.1 time: 0.154610 Sep 13 10:25:53.133876 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 567/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:52 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:25:54.157655 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:54.158517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:54.164963 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:54.165453 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:54.165883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:54.166579 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:54.167028 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:54.167479 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:54.305732 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:54.313471 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-0eb4b718-d241-487f-8616-6210cd72dd6f tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1508 microversion: 2.1 time: 0.160933 Sep 13 10:25:54.314039 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 563/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:54 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 10:25:54.336347 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdfc6fee-471b-4a7d-aa9f-e9495514844f", "device": "/dev/sdb"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:25:54.340896 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:54.345967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:54.346462 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:54.346905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:54.347642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:54.348103 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:54.348531 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:55.129879 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-bad32bc2-6adc-4d9c-b547-be8c6624cb71 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "POST /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797400 Sep 13 10:25:55.130502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 568/1131] 10.222.0.62 () {60 vars in 1323 bytes} [Tue Sep 13 10:25:54 2022] POST /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:25:58.745975 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:25:58.746587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:25:58.749042 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell0:SELECT=2 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:25:58.753876 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:58.754356 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:58.754783 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:58.755518 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:25:58.755988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:25:58.756399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:25:58.892211 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:25:58.900863 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-704e1602-caa1-4f45-9593-3ab3f1ac02c1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1594 microversion: 2.1 time: 0.159048 Sep 13 10:25:58.901428 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 564/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:25:58 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:00.891427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:00.906350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:00.907072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:00.907779 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:00.919637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] Creating event network-changed:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:26:00.924772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-12b4ad1c-c4bc-4f77-afb5-ee2a90bf68aa req-019d7cf2-38ab-4ee2-b4a2-2a6494438cdf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 Sep 13 10:26:00.925373 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 569/1133] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:26:03.376090 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1405116721"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:03.376664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:03.383138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:03.385322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:03.385322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:03.385322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:03.385322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:03.385801 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:03.510427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.network.security_group_api [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Adding security group 31a9fb20-2472-4506-b14b-878e43d0288e to port c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 Sep 13 10:26:03.908397 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-29222d67-2085-4311-baf4-29b3ee296b45 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action" status: 202 len: 0 microversion: 2.1 time: 0.536351 Sep 13 10:26:03.909012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 565/1134] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:26:03 2022] POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:26:03.918642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:03.922822 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:03.923888 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:03.929301 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:03.930058 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:03.930300 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:03.930780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:03.931292 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:03.932531 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:03.933464 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:03.934270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:03.934915 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:03.958385 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] Creating event network-changed:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:26:03.969139 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-00b0afcc-cb98-4a00-9cd3-e4391c83fe0d req-af288b49-8e52-4730-89aa-e642b57d0f79 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055854 Sep 13 10:26:03.970891 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 570/1135] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:26:04.132866 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:04.141583 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d3299ac3-6a74-4836-a5eb-5fba25bb9540 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1760 microversion: 2.1 time: 0.222846 Sep 13 10:26:04.142219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 566/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:03 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1760 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:18.350970 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=31 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:18.351758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:18.357099 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:18.357695 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:18.363904 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:18.364388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:18.364823 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:18.365529 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:18.365992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:18.366427 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:18.446568 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lazy-loading 'services' on Instance uuid 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:26:18.609837 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cc3553f4-86f5-4cf1-b9f8-668b7d5ba877 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "DELETE /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1/os-volume_attachments/cdfc6fee-471b-4a7d-aa9f-e9495514844f" status: 202 len: 0 microversion: 2.1 time: 0.260149 Sep 13 10:26:18.610353 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 571/1137] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:26:18 2022] DELETE /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1/os-volume_attachments/cdfc6fee-471b-4a7d-aa9f-e9495514844f => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:26:20.788749 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:20.789341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:20.792661 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=27 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:20.793817 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:20.800124 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:20.818526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:20.818526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:20.818526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:20.818526 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:20.818988 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:20.828970 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:26:21.141604 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-afa180ca-e347-48fa-b48c-fc4f9beb5b33 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "DELETE /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 204 len: 0 microversion: 2.1 time: 0.356465 Sep 13 10:26:21.142230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 567/1138] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:26:20 2022] DELETE /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:26:21.152917 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:21.153623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:21.159991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:21.160487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:21.160924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:21.161665 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:21.162117 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:21.162541 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:21.294405 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:21.302261 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e0017e2d-891d-4ae1-afb2-b9062f54534b tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1514 microversion: 2.1 time: 0.155127 Sep 13 10:26:21.306338 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 572/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:21 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:22.326302 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:22.327011 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:22.333333 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:22.333825 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:22.334225 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:22.334897 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:22.335374 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:22.335787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:22.463891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:22.471484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ac5ee887-b732-40da-a9ac-10d015f6abef tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1514 microversion: 2.1 time: 0.150035 Sep 13 10:26:22.472051 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 568/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:22 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:23.495188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:23.495826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:23.502214 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:23.502693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:23.503129 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:23.503845 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:23.504298 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:23.504723 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:23.574805 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a6e7e1e625247a3963aa8a0a29eb478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8879b3720c0d482d8118a0d2e5590b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:23.583416 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ca925fdb-8012-41ca-9caa-541aa5e71389 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 200 len: 1472 microversion: 2.1 time: 0.092547 Sep 13 10:26:23.584595 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 573/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:23 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:23.656248 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b41dbc-aaf8-40d3-bc50-3181da5d9be1", "name": "network-vif-deleted", "tag": "4ea80b05-ea23-47ba-9009-b42713d74310"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:23.666852 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:23.668005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:23.668005 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:23.678649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] Creating event network-vif-deleted:4ea80b05-ea23-47ba-9009-b42713d74310 for instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 on hv-cinder-85427 Sep 13 10:26:23.683947 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-a01b52bb-2970-4630-8584-b2e3bc5e2587 req-c9644240-ae18-41ea-9bbd-4617eec7de57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031393 Sep 13 10:26:23.684516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 569/1142] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:26:24.607499 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:24.608133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] [instance: 50b41dbc-aaf8-40d3-bc50-3181da5d9be1] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:24.615134 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:24.615672 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:24.616126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:24.616822 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:24.617280 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:24.617709 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:24.631432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] HTTP exception thrown: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Request method failure captured: Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 HTTP/1.1 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFo9Gud1e_e_F4DkMaRiwaDK2audvNvF-lH_WMnf5r6J8e6ug-3jqfVWjEKp0zDHmRUPVNzkJXCbUPJ65VAHYjjiZ0jtgj3GHkf3WFsVrvOeZmhJqYGzwmdMGWv3yoh2q0coLTaxllSMMnYDyDlfN_zoxPTT_McHkg1BeMC8bh9eqy4 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 8879b3720c0d482d8118a0d2e5590b54 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:26:24.636069 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8879b3720c0d482d8118a0d2e5590b54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 8879b3720c0d482d8118a0d2e5590b54 Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1157562262 Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-VolumesSnapshotTestJSON-1157562262-project Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 9a6e7e1e625247a3963aa8a0a29eb478 Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-VolumesSnapshotTestJSON-1157562262-project Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. Sep 13 10:26:24.637623 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '50b41dbc-aaf8-40d3-bc50-3181da5d9be1'} Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:26:24.638469 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. Sep 13 10:26:24.639966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:26:24.641528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] Returning 404 to user: Instance 50b41dbc-aaf8-40d3-bc50-3181da5d9be1 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:26:24.641528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-703eed2e-6675-4c9f-8866-f5fce1d364d0 tempest-VolumesSnapshotTestJSON-1157562262 tempest-VolumesSnapshotTestJSON-1157562262-project] 10.222.0.62 "GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1" status: 404 len: 111 microversion: 2.1 time: 0.030997 Sep 13 10:26:24.641528 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 574/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:24 2022] GET /compute/v2.1/servers/50b41dbc-aaf8-40d3-bc50-3181da5d9be1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:26:36.537252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:36.538073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:36.542122 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:36.544525 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:36.554958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:36.554958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:36.554958 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:36.555349 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:36.555494 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:36.555916 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:36.801427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-2b3e6b88-e9b8-4b34-8535-ec60544ffebd tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action" status: 202 len: 0 microversion: 2.1 time: 0.261538 Sep 13 10:26:36.801427 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 570/1144] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:26:36 2022] POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:26:36.809150 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:36.809769 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:36.811919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=8 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:36.812578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:36.817206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:36.817693 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:36.818133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:36.818835 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:36.819339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:36.819794 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:36.964049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:36.972350 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-4fade4d6-1f36-4af6-82b6-ec74aaac3af3 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1752 microversion: 2.1 time: 0.167916 Sep 13 10:26:36.972919 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 575/1145] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:36 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:37.998344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:37.999037 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:38.005722 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:38.006204 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:38.006638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:38.007350 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:38.007805 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:38.008230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:38.152500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:38.160622 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3c1cc810-b3ec-4643-aa32-15e1ec26504e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1752 microversion: 2.1 time: 0.167490 Sep 13 10:26:38.161188 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 571/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:37 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:39.183905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:39.184638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:39.191484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:39.191968 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:39.192402 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:39.193093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:39.193546 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:39.194007 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:39.418143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:39.426382 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-101ef8f9-c7cd-42dc-8b86-75a0b5c8c1af tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1752 microversion: 2.1 time: 0.246679 Sep 13 10:26:39.426959 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 576/1147] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:39 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:40.450312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:40.451055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:40.457407 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:40.457894 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:40.458330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:40.459060 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:40.459547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:40.459981 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:40.600630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:40.610627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3808f5d8-5068-4c15-8e58-d008181e0e78 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.163952 Sep 13 10:26:40.610627 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 572/1148] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:40 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:41.633436 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:41.634048 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:41.640349 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:41.640832 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:41.641264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:41.642037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:41.642436 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:41.642861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:41.790374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:41.799328 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-0a7407f1-dfaf-4d5a-bd11-a93afb151b0a tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.169647 Sep 13 10:26:41.799915 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 577/1149] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:41 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:42.822657 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:42.823307 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:42.829598 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:42.830073 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:42.830500 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:42.831230 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:42.831680 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:42.832094 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:42.980436 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:42.989978 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-e9ef149d-d5d5-4520-8742-30aa800c056d tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.171016 Sep 13 10:26:42.992109 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 573/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:42 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:44.018104 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:44.019052 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:44.025697 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:44.026188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:44.026635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:44.027367 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:44.027836 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:44.028267 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:44.174096 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:44.182231 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-63e7ec7a-7c43-4747-b4bf-b8a9ca755605 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.168237 Sep 13 10:26:44.183432 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 578/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:44 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:45.205675 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:45.206282 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:45.212695 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:45.213173 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:45.213602 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:45.216203 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:45.216658 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:45.217079 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:45.359800 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:45.367831 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5d37165b-4f0c-4fa3-a968-e56ea48fe209 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.165949 Sep 13 10:26:45.368394 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 574/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:45 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:46.392831 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:46.393921 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:46.400140 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:46.400619 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:46.401049 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:46.401737 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:46.402188 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:46.402620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:46.543135 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:46.552110 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-83cefb21-108b-4a29-a09e-e371177a8b97 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.163147 Sep 13 10:26:46.552692 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 579/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:46 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:47.576176 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:47.576943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:47.582994 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:47.583529 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:47.583964 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:47.584664 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:47.585120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:47.585549 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:47.727117 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:47.735157 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-dbeed00b-0c5f-4ee8-b87c-2a2b46c17b56 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.162827 Sep 13 10:26:47.735728 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 575/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:47 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:48.757793 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:48.758398 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:48.765010 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:48.765482 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:48.765913 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:48.766590 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:48.767037 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:48.767487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:48.909902 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:48.918085 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-f55fcd97-08b8-4f69-8963-5353d8223efa tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.164188 Sep 13 10:26:48.919250 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 580/1155] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:48 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:49.941917 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:49.942539 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:49.949002 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:49.949517 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:49.950030 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:49.950647 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:49.951138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:49.951605 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:50.110911 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:50.119369 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-130f70e1-eac6-4837-b416-6adbfffbfe85 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.181393 Sep 13 10:26:50.120001 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 576/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:49 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:51.145558 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:51.146153 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:51.154021 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.154368 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.154805 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.156451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.156451 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.156673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.198423 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:51.198969 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:51.210799 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.211345 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.211792 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.212705 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.213170 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.213599 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.239937 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:26:51.337591 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:51.345098 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ac0f8375-5856-44ef-b437-a805d5f0a058 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.203340 Sep 13 10:26:51.345673 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 581/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:51 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:51.494905 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29b9f57-00c0-4847-9bdb-c5f65fb7059a", "tag": "bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:51.508777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.509640 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.510484 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.526092 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] Creating event network-changed:bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2 for instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a on hv-cinder-85427 Sep 13 10:26:51.529280 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-7cf40a1f-a187-4861-bef4-aa45d3d675f6 req-90345243-a6be-4008-abf7-229a9c25d1ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182167 Sep 13 10:26:51.530314 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 582/1158] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:26:51.645062 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-400c3bc4-8c36-4b03-aae1-075cb329903d tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 204 len: 0 microversion: 2.1 time: 0.450124 Sep 13 10:26:51.645649 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 577/1159] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:26:51 2022] DELETE /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:26:51.657909 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:51.658615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:51.665089 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.665578 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.666210 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.667093 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:51.667745 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:51.669034 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:51.836329 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:51.844873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-ff802dcc-b744-4630-8fca-44e4a5c24b81 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1576 microversion: 2.1 time: 0.192061 Sep 13 10:26:51.845513 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 583/1160] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:51 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:52.370882 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:52.372219 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:52.378912 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:52.384217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:52.384217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:52.384217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:52.384217 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:52.384632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:52.529131 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:52.539070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-4eb03aca-4d0f-45ec-9d32-9c3b0dc85e21 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.172611 Sep 13 10:26:52.539727 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 578/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:52 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:52.868973 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:52.869563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:52.876574 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:52.877060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:52.877491 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:52.878178 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:52.878627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:52.879047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:53.070388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:53.078143 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-abb1e353-776b-498b-8583-3ef2e6e328eb tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1576 microversion: 2.1 time: 0.212987 Sep 13 10:26:53.078851 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 584/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:52 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:53.562686 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:53.563328 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:53.569779 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:53.570261 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:53.570698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:53.571424 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:53.571881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:53.572312 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:53.789196 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:53.798097 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-ccccb219-978b-45cc-be2e-d3c22dcef102 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.239811 Sep 13 10:26:53.798668 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 579/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:53 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:53.952380 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29b9f57-00c0-4847-9bdb-c5f65fb7059a", "name": "network-vif-deleted", "tag": "bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:53.961966 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:53.962454 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:53.962873 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:53.973712 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] Creating event network-vif-deleted:bc5d6e33-5588-46a0-b9c5-bb7ef6abc2f2 for instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a on hv-cinder-85427 Sep 13 10:26:53.978487 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-306f4dd7-fa0b-4890-8ec6-68fdc8c93cf8 req-673e945e-484a-45ba-ad60-9399261d65c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211456 Sep 13 10:26:53.979060 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 585/1164] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:26:54.101943 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:54.102562 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:54.108995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:54.109484 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:54.109925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:54.110630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:54.111179 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:54.118344 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:54.177677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:54.188150 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-eae50bb5-0d89-4eed-bbb3-4db9c9c4f982 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 200 len: 1224 microversion: 2.1 time: 0.090086 Sep 13 10:26:54.188564 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 580/1165] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:54 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:54.822512 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:54.823257 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:54.829637 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:54.830124 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:54.830563 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:54.831297 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:54.831754 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:54.832180 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:54.975747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:54.984596 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-288c68f7-e523-4563-9e4e-098652aa5cc1 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1757 microversion: 2.1 time: 0.166468 Sep 13 10:26:54.985189 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 586/1166] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:54 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:55.214360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:55.214360 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: a29b9f57-00c0-4847-9bdb-c5f65fb7059a] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:55.218712 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:55.219270 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:55.219714 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:55.220409 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:55.220870 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:55.221363 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:55.236240 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] HTTP exception thrown: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Request method failure captured: Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a HTTP/1.1 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFjTdvlu7ezD-t4fwu8HsgJR-A0ccTknqfNhW2EWI6YF-aOuCoG_JIvvDtRlIEFJE2ab2qwib6DZOszmh5Og-ZNop2uRjCk7QDHCEzDTS983NnmQnZ-cTd46suzaUofepsKD1ocOvc_XwANVugA0pbGwxUeH4H2fKPt2_jcyyNwww_Y Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:26:55.237877 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7cc199dd87e24511a8d267603b571456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7cc199dd87e24511a8d267603b571456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-TestVolumeBootPattern-485337623 Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 7ddb2572cac446aa92a0bcf170d9e8d6 Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. Sep 13 10:26:55.239811 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a29b9f57-00c0-4847-9bdb-c5f65fb7059a'} Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:26:55.241035 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. Sep 13 10:26:55.243243 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:26:55.244892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Returning 404 to user: Instance a29b9f57-00c0-4847-9bdb-c5f65fb7059a could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:26:55.244892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d0f90762-87a6-4330-b2a7-5ea98e46036f tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a" status: 404 len: 111 microversion: 2.1 time: 0.032475 Sep 13 10:26:55.244892 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 581/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:55 2022] GET /compute/v2.1/servers/a29b9f57-00c0-4847-9bdb-c5f65fb7059a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:26:56.009991 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:56.010635 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:56.017087 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:56.017572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:56.018011 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:56.018758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:56.019238 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:56.019674 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:56.413330 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:56.422282 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-257eb7b9-1704-4b87-9c14-7a096970d220 tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1760 microversion: 2.1 time: 0.416490 Sep 13 10:26:56.422848 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 587/1168] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:56 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1760 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:26:58.972129 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:58.972637 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:58.981546 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:58.981925 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:58.982091 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7076380-769c-4eca-8ad6-75ec464b6010", "tag": "d433bce5-ddb4-4a98-b0a8-0d99788a0849"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:26:58.982536 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:58.983055 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:58.983850 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:58.984399 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:59.004478 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:59.005323 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:59.005755 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:59.012213 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Going to try to terminate instance {{(pid=121002) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:26:59.017249 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] Creating event network-changed:d433bce5-ddb4-4a98-b0a8-0d99788a0849 for instance f7076380-769c-4eca-8ad6-75ec464b6010 on hv-cinder-85427 Sep 13 10:26:59.022603 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-d8a69aab-423f-4e42-af1c-cd691604a4bc req-f5fe1a63-a1b0-4c87-b79b-28df1a3b6d7d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045895 Sep 13 10:26:59.023644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 588/1169] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 10:26:59.118665 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:26:59.323874 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-3a5cfbbc-6548-48ea-9626-831397d1b5ba tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 204 len: 0 microversion: 2.1 time: 0.355687 Sep 13 10:26:59.324469 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 582/1170] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:26:58 2022] DELETE /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:26:59.333861 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:26:59.341225 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:26:59.343259 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:59.343923 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:59.344472 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:59.345206 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:26:59.345717 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:26:59.346205 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:26:59.527791 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:26:59.535502 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-cdd47d75-84b0-4aaf-afcd-239690340239 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1576 microversion: 2.1 time: 0.205909 Sep 13 10:26:59.536063 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 589/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:26:59 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:00.560417 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:00.561120 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:00.568159 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:00.568635 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:00.569070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:00.569753 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:00.570202 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:00.570621 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:00.702929 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:27:00.710612 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-c2b5d092-923b-4adc-ae07-fdce38170ad9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1576 microversion: 2.1 time: 0.155140 Sep 13 10:27:00.711182 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 583/1172] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:00 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:01.502777 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7076380-769c-4eca-8ad6-75ec464b6010", "name": "network-vif-deleted", "tag": "d433bce5-ddb4-4a98-b0a8-0d99788a0849"}]} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:27:01.520976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:01.520976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:01.520976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:01.525874 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.compute.server_external_events [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] Creating event network-vif-deleted:d433bce5-ddb4-4a98-b0a8-0d99788a0849 for instance f7076380-769c-4eca-8ad6-75ec464b6010 on hv-cinder-85427 Sep 13 10:27:01.530924 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [req-4325ada7-6d9a-4946-81cd-854e19c5208b req-e9ea1a46-9a3e-49c8-96dc-0803f0796d3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 Sep 13 10:27:01.531746 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 590/1173] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:27:01.734324 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:01.734938 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:01.741272 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:01.741745 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:01.742180 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:01.742858 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:01.743341 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:01.743762 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:01.807322 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ddb2572cac446aa92a0bcf170d9e8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc199dd87e24511a8d267603b571456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:27:01.815757 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-5cff634d-6dfe-41be-b2ec-77609d3808ac tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 200 len: 1225 microversion: 2.1 time: 0.085720 Sep 13 10:27:01.816330 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 584/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:01 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:02.839364 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:02.840072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: f7076380-769c-4eca-8ad6-75ec464b6010] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:02.847552 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:02.848044 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:02.848483 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:02.849181 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:02.849638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:02.850090 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:02.866186 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] HTTP exception thrown: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Request method failure captured: Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 HTTP/1.1 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFjTdvlu7ezD-t4fwu8HsgJR-A0ccTknqfNhW2EWI6YF-aOuCoG_JIvvDtRlIEFJE2ab2qwib6DZOszmh5Og-ZNop2uRjCk7QDHCEzDTS983NnmQnZ-cTd46suzaUofepsKD1ocOvc_XwANVugA0pbGwxUeH4H2fKPt2_jcyyNwww_Y Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:27:02.867850 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7cc199dd87e24511a8d267603b571456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7cc199dd87e24511a8d267603b571456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 7ddb2572cac446aa92a0bcf170d9e8d6 Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. Sep 13 10:27:02.869539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': 'f7076380-769c-4eca-8ad6-75ec464b6010'} Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:27:02.870780 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. Sep 13 10:27:02.873016 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:02.874631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Returning 404 to user: Instance f7076380-769c-4eca-8ad6-75ec464b6010 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:27:02.874631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a1309234-5a53-4528-afe5-e239a4ec7e7b tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010" status: 404 len: 111 microversion: 2.1 time: 0.034289 Sep 13 10:27:02.874631 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 591/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:02 2022] GET /compute/v2.1/servers/f7076380-769c-4eca-8ad6-75ec464b6010 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:27:03.359102 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:03.359638 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:03.365995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:03.366474 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:03.366914 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:03.367624 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:03.368081 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:03.368503 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:03.382174 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] HTTP exception thrown: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Request method failure captured: Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 HTTP/1.1 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFjTdvlu7ezD-t4fwu8HsgJR-A0ccTknqfNhW2EWI6YF-aOuCoG_JIvvDtRlIEFJE2ab2qwib6DZOszmh5Og-ZNop2uRjCk7QDHCEzDTS983NnmQnZ-cTd46suzaUofepsKD1ocOvc_XwANVugA0pbGwxUeH4H2fKPt2_jcyyNwww_Y Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:27:03.383857 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7cc199dd87e24511a8d267603b571456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7cc199dd87e24511a8d267603b571456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 7ddb2572cac446aa92a0bcf170d9e8d6 Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.385545 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': '7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3'} Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:27:03.386372 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.387754 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.390013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Returning 404 to user: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:27:03.390013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-d52bd8f1-a2ba-4c8b-8401-241b67f9cc64 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 404 len: 111 microversion: 2.1 time: 0.030682 Sep 13 10:27:03.390013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 585/1176] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:27:03 2022] DELETE /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:27:03.394361 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:03.394976 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] [instance: 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:03.401283 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:03.401770 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:03.402207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:03.402901 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:03.403396 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:03.403826 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:03.417177 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.wsgi [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] HTTP exception thrown: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Request method failure captured: Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: request: GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 HTTP/1.1 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept: application/json Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Accept-Encoding: identity Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Connection: close Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Length: 0 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Content-Type: application/json Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Host: 10.222.0.62 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: Openstack-System-Scope: None Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: User-Agent: python-urllib3/1.26.12 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Auth-Token: gAAAAABjIFjTdvlu7ezD-t4fwu8HsgJR-A0ccTknqfNhW2EWI6YF-aOuCoG_JIvvDtRlIEFJE2ab2qwib6DZOszmh5Og-ZNop2uRjCk7QDHCEzDTS983NnmQnZ-cTd46suzaUofepsKD1ocOvc_XwANVugA0pbGwxUeH4H2fKPt2_jcyyNwww_Y Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Id: None Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Domain-Name: None Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Identity-Status: Confirmed Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Is-Admin-Project: True Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Id: default Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Domain-Name: Default Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Project-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Role: reader,member Sep 13 10:27:03.419207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Roles: reader,member Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7cc199dd87e24511a8d267603b571456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7cc199dd87e24511a8d267603b571456"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7cc199dd87e24511a8d267603b571456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Id: 7cc199dd87e24511a8d267603b571456 Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-Tenant-Name: tempest-TestVolumeBootPattern-485337623 Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Id: default Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Domain-Name: Default Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Id: 7ddb2572cac446aa92a0bcf170d9e8d6 Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: X-User-Name: tempest-TestVolumeBootPattern-485337623-project Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: method: > Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: exception: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.420782 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: action_args: {'id': '7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3'} Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:27:03.421678 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. Sep 13 10:27:03.423040 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: ERROR nova.api.openstack.wsgi Sep 13 10:27:03.424388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Returning 404 to user: Instance 7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 could not be found. {{(pid=121003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:27:03.424388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-8cc16565-12a1-4afd-9971-cc1eb439b15e tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3" status: 404 len: 111 microversion: 2.1 time: 0.030183 Sep 13 10:27:03.424388 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 592/1177] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:03 2022] GET /compute/v2.1/servers/7b26dac9-9f7f-4f42-bb2a-a6e26c2d91c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:27:04.894099 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-be99bdf5-ab06-47e4-8cb5-6a59aca0e9d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] Calling method '.version_select at 0x7f46c47a6430>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:04.964830 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-be99bdf5-ab06-47e4-8cb5-6a59aca0e9d9 tempest-TestVolumeBootPattern-485337623 tempest-TestVolumeBootPattern-485337623-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-869991838" status: 202 len: 0 microversion: 2.1 time: 0.074547 Sep 13 10:27:04.965439 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 586/1178] 10.222.0.62 () {58 vars in 1260 bytes} [Tue Sep 13 10:27:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-869991838 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:27:29.043731 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1405116721"}} {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:27:29.044319 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:29.047064 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_api:SELECT=36 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:27:29.047750 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG dbcounter [-] [121003] Writing DB stats nova_cell1:SELECT=84 {{(pid=121003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:27:29.052450 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:29.052936 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:29.053374 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:29.054072 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:29.054539 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:29.054967 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:29.184602 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.network.security_group_api [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Removing security group 31a9fb20-2472-4506-b14b-878e43d0288e from port c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 Sep 13 10:27:29.798852 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-6690c363-ceab-4c66-8927-a67233dff6ae tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action" status: 202 len: 0 microversion: 2.1 time: 0.759249 Sep 13 10:27:29.803410 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 593/1179] 10.222.0.62 () {60 vars in 1278 bytes} [Tue Sep 13 10:27:29 2022] POST /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:27:29.808414 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:27:29.820393 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_cell1:SELECT=14 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:27:29.825138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG dbcounter [-] [121002] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 10:27:29.825138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:29.825138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:29.825138 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:29.838127 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] Creating event network-changed:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:27:29.843883 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-b3540baf-cfaa-436d-82f0-055fbf5f5e6b req-1fe20f84-ae31-4eeb-8abe-8836c6504efe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038984 Sep 13 10:27:29.845378 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 587/1180] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:27:31.233050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:27:31.240584 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:31.241113 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:31.244057 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:31.244533 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:31.244963 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:31.248266 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:31.249355 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:31.249872 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:31.250691 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:31.251252 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:31.251747 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:31.256632 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] Creating event network-changed:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:27:31.261590 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-cee1b78b-f54f-457c-9ae5-dddb938f2050 req-1fc6fdb8-7e5b-4442-b58b-99fb46287560 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033299 Sep 13 10:27:31.262700 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 588/1181] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:27:31.348772 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.objects.instance [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lazy-loading 'services' on Instance uuid a7c73516-f0e4-4942-8e1e-b76ae4169985 {{(pid=121003) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 10:27:31.591054 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-b36ccd0f-524d-4066-9ba5-40e94acee2be tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments/4b82143c-5a61-4afb-85ba-59d8a57ed63e" status: 202 len: 0 microversion: 2.1 time: 0.365124 Sep 13 10:27:31.592544 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 594/1182] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:27:31 2022] DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments/4b82143c-5a61-4afb-85ba-59d8a57ed63e => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 10:27:31.601475 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:31.604008 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:31.611977 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:31.612463 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:31.613130 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:31.613983 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:31.614442 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:31.614881 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:31.646678 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-71ef8e2e-f746-40ae-81a1-a9ff61233a8e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049710 Sep 13 10:27:31.647271 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 589/1183] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:27:31 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:27:32.661360 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:32.663638 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:32.670067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:32.670572 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:32.671046 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:32.671758 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:32.672207 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:32.672629 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:32.700627 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-53bb475b-6a8c-40f8-a320-6c7dfa56b36b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044150 Sep 13 10:27:32.701166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 595/1184] 10.222.0.62 () {58 vars in 1302 bytes} [Tue Sep 13 10:27:32 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 10:27:32.712169 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:32.712656 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:32.719950 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:32.720433 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:32.720871 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:32.721558 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:32.722012 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:32.722441 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:32.795383 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] HTTP exception thrown: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 is not attached to volume 4b82143c-5a61-4afb-85ba-59d8a57ed63e Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Request method failure captured: Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments/4b82143c-5a61-4afb-85ba-59d8a57ed63e HTTP/1.1 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFp_ACh6trcnjbAF4PEHa09CwGLN7_Qnb7eGeJcT9PraBdYrABgl27xsqixZ_-DnNFAKNayL2uLQOaC59HunTyJt5P1Fm0dRL42KgXGXNXFVsLq5FE-kDH3K6UnZzq5IpeTJYrBlHUI64g2kff2OSFSO16brf9X5wrucvkByngEiwac Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: d3610ef4e07548e1a88d76356d8170a6 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:27:32.797708 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: d3610ef4e07548e1a88d76356d8170a6 Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-TestMinimumBasicScenario-1556249479-project Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 31a26b7651fd463393526fab64ccf1c7 Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-TestMinimumBasicScenario-1556249479-project Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:27:32.799516 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 is not attached to volume 4b82143c-5a61-4afb-85ba-59d8a57ed63e Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'server_id': 'a7c73516-f0e4-4942-8e1e-b76ae4169985', 'id': '4b82143c-5a61-4afb-85ba-59d8a57ed63e'} Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4b82143c-5a61-4afb-85ba-59d8a57ed63e. Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:27:32.800459 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 is not attached to volume 4b82143c-5a61-4afb-85ba-59d8a57ed63e Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 is not attached to volume 4b82143c-5a61-4afb-85ba-59d8a57ed63e Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:32.801827 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Returning 404 to user: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 is not attached to volume 4b82143c-5a61-4afb-85ba-59d8a57ed63e {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:27:32.802891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-15a8d9f9-b2ec-4e74-b573-c38147957b2e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments/4b82143c-5a61-4afb-85ba-59d8a57ed63e" status: 404 len: 154 microversion: 2.1 time: 0.090948 Sep 13 10:27:32.802891 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 590/1185] 10.222.0.62 () {58 vars in 1416 bytes} [Tue Sep 13 10:27:32 2022] DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985/os-volume_attachments/4b82143c-5a61-4afb-85ba-59d8a57ed63e => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:27:34.118126 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:34.118620 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:34.125159 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:34.125642 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:34.126067 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:34.126748 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:34.127211 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:34.127659 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:34.152559 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Going to try to terminate instance {{(pid=121003) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 10:27:34.437441 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-e22a4d14-e527-4ee9-afb1-dd4bfc1d1e8b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 204 len: 0 microversion: 2.1 time: 0.322717 Sep 13 10:27:34.438025 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 596/1186] 10.222.0.62 () {58 vars in 1239 bytes} [Tue Sep 13 10:27:34 2022] DELETE /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 10:27:34.446252 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:34.446869 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:34.455478 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:34.455960 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:34.456395 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:34.457136 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:34.457587 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:34.458013 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:34.587995 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.policy [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121002) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:27:34.595698 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-071f85d2-9cca-49f1-b191-5453ab29262b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1554 microversion: 2.1 time: 0.153245 Sep 13 10:27:34.596259 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 591/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:34 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:35.620444 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:35.621149 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:35.627648 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:35.628133 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:35.628571 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:35.629264 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:35.629722 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:35.630151 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:35.757339 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:27:35.765644 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a7b5ebfb-9f73-480e-ba4f-d1d9462d91ad tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1554 microversion: 2.1 time: 0.149493 Sep 13 10:27:35.766209 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 597/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:35 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:36.725797 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c73516-f0e4-4942-8e1e-b76ae4169985", "name": "network-vif-deleted", "tag": "c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21"}]} {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 10:27:36.736520 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:36.737547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:36.737547 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:36.748704 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.compute.server_external_events [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] Creating event network-vif-deleted:c4dafcf5-2485-4e6d-98b4-26fe9f9ffc21 for instance a7c73516-f0e4-4942-8e1e-b76ae4169985 on hv-cinder-85427 Sep 13 10:27:36.753685 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [req-34eccb29-a8cf-43d1-920d-61dd3ee7bce1 req-6b2c3e46-f3f2-4545-955e-efa4fb74d528 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Sep 13 10:27:36.754468 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 592/1189] 10.222.0.62 () {64 vars in 1317 bytes} [Tue Sep 13 10:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 10:27:36.788887 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:36.789710 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.compute.api [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121003) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:36.797047 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:36.797613 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:36.798125 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:36.798897 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:36.799474 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:36.799992 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG oslo_concurrency.lockutils [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:36.863915 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.policy [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31a26b7651fd463393526fab64ccf1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3610ef4e07548e1a88d76356d8170a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121003) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 10:27:36.871583 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-7c145f12-1133-4c47-899b-3d6dd973a59f tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 200 len: 1512 microversion: 2.1 time: 0.086579 Sep 13 10:27:36.872166 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 598/1190] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:36 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 10:27:37.894961 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '>' {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:37.895696 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.compute.api [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] [instance: a7c73516-f0e4-4942-8e1e-b76ae4169985] Fetching instance by UUID {{(pid=121002) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 10:27:37.902145 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:37.902630 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:37.903070 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:37.903787 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Acquiring lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 10:27:37.904284 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 10:27:37.904677 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG oslo_concurrency.lockutils [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Lock "1c3ea186-2f17-4a7c-930c-366f78bd7594" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 10:27:37.919146 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.wsgi [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] HTTP exception thrown: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Request method failure captured: Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: request: GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 HTTP/1.1 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept: application/json Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Accept-Encoding: identity Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Connection: close Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Length: 0 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Content-Type: application/json Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Host: 10.222.0.62 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: Openstack-System-Scope: None Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: User-Agent: python-urllib3/1.26.12 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Auth-Token: gAAAAABjIFp_ACh6trcnjbAF4PEHa09CwGLN7_Qnb7eGeJcT9PraBdYrABgl27xsqixZ_-DnNFAKNayL2uLQOaC59HunTyJt5P1Fm0dRL42KgXGXNXFVsLq5FE-kDH3K6UnZzq5IpeTJYrBlHUI64g2kff2OSFSO16brf9X5wrucvkByngEiwac Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Id: None Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Domain-Name: None Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Identity-Status: Confirmed Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Is-Admin-Project: True Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Id: default Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Domain-Name: Default Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Id: d3610ef4e07548e1a88d76356d8170a6 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Project-Name: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Role: reader,member Sep 13 10:27:37.921265 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Roles: reader,member Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d3610ef4e07548e1a88d76356d8170a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Id: d3610ef4e07548e1a88d76356d8170a6 Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1556249479 Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User: tempest-TestMinimumBasicScenario-1556249479-project Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Id: default Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Domain-Name: Default Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Id: 31a26b7651fd463393526fab64ccf1c7 Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: X-User-Name: tempest-TestMinimumBasicScenario-1556249479-project Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: method: > Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: exception: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. Sep 13 10:27:37.922967 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: action_args: {'id': 'a7c73516-f0e4-4942-8e1e-b76ae4169985'} Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: {{(pid=121002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 10:27:37.924050 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. Sep 13 10:27:37.925692 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: ERROR nova.api.openstack.wsgi Sep 13 10:27:37.927273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: DEBUG nova.api.openstack.wsgi [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Returning 404 to user: Instance a7c73516-f0e4-4942-8e1e-b76ae4169985 could not be found. {{(pid=121002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 10:27:37.927273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: INFO nova.api.openstack.requestlog [None req-9e5e3f60-fa35-4fbe-b009-3f3a9dc0e49e tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985" status: 404 len: 111 microversion: 2.1 time: 0.032420 Sep 13 10:27:37.927273 dv-cinder-854274-4-iscsi devstack@n-api.service[121002]: [pid: 121002|app: 0|req: 593/1191] 10.222.0.62 () {58 vars in 1236 bytes} [Tue Sep 13 10:27:37 2022] GET /compute/v2.1/servers/a7c73516-f0e4-4942-8e1e-b76ae4169985 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 10:27:37.931372 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: DEBUG nova.api.openstack.wsgi [None req-a651272a-0eec-4332-8f4d-e15ab04fe72b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] Calling method '.version_select at 0x7f46c0fc5700>' {{(pid=121003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 10:27:37.997615 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: INFO nova.api.openstack.requestlog [None req-a651272a-0eec-4332-8f4d-e15ab04fe72b tempest-TestMinimumBasicScenario-1556249479 tempest-TestMinimumBasicScenario-1556249479-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-782283516" status: 202 len: 0 microversion: 2.1 time: 0.070027 Sep 13 10:27:37.998190 dv-cinder-854274-4-iscsi devstack@n-api.service[121003]: [pid: 121003|app: 0|req: 599/1192] 10.222.0.62 () {58 vars in 1269 bytes} [Tue Sep 13 10:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-782283516 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)